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ABSTRACT 


The  goal  of  this  thesis  is  to  improve  Department  of  Defense  (DOD)  policy  and 
guidance  to  help  program  managers  and  product  support  managers  effectively  employ 
Performance  Based  Logistics  (PBL)  as  a  product  support  strategy.  If  properly  utilized,  a 
PBL  approach  can  reduce  a  weapon  system’s  life  cycle  cost,  increase  its  availability  to 
the  warfighter,  and  reduce  the  logistics  footprint  traditionally  required  to  sustain  it.  This 
thesis  contains  a  thorough  analysis  of  the  most  current  and  relevant  DOD  policies  and 
guidance  to  determine  whether  they  adequately  support  implementation  of  PBL.  A  model 
is  presented  to  aid  readers  through  the  analysis  of  the  selected  documentation  to  identify 
areas  where  policy  refinement  and  additional  guidance  may  improve  understanding  and 
awareness  of  PBL.  This  thesis  makes  recommendations  on  closing  the  identified 
information  gaps  with  the  aim  to  strengthen  PBL  policies  and  procedures.  Major  findings 
that  trend  across  the  reviewed  documents  or  pose  significant  problems  for  implementing 
PBL  are  addressed  with  recommendations.  The  desired  result  of  this  research  is  to 
improve  existing  PBL  policy  and  guidance  in  order  to  ultimately  provide  affordable  and 
effective  weapons  systems  in  the  defense  of  our  nation. 
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EXECUTIVE  SUMMARY 


The  objective  of  this  thesis  is  to  improve  Department  of  Defense  (DOD)  policy 
and  guidance  and  better  assist  program  managers  and  product  support  managers  to 
effectively  employ  Perfonnance  Based  Logistics  (PBL)  as  a  product  support  strategy.  If 
properly  utilized,  a  PBL  approach  can  reduce  a  weapon  system’s  life  cycle  cost,  increase 
its  availability  to  the  warfighter,  and  reduce  the  logistics  footprint  traditionally  required 
to  sustain  it.  This  is  not  a  new  concept,  as  it  has  already  been  used  effectively  by  the 
commercial  aviation  industry  to  maintain  aircraft  fleet  readiness. 

This  thesis  contains  a  thorough  analysis  to  detennine  if  the  most  current  and 
relevant  DOD  policies  and  guidance  adequately  support  implementation  of  PBL.  A  total 
of  six  different  DOD-level  policy  and  guidance  documents  were  reviewed.  Four  of  the  six 
are  considered  policy  documents.  They  primarily  establish  PBL  policy  and  provide  a 
limited  amount  of  background  and  definition  in  support  of  the  direction.  The  other  two 
documents  are  the  Product  Support  Manager  (PSM)  Guidebook  (2011)  and  the 
Performance  Based  Logistics  (PBL)  Guidebook  (2014),  both  published  by  the  Assistant 
Secretary  of  Defense  (Logistics  and  Materiel  Readiness)  (ASD  (L&MR)).  They  are 
guidance  documents  and  do  not  provide  any  direction  or  policy  but  instead  supplement 
the  PBL-related  policies  by  adding  more  detailed  information  and  guidance  on  PBL  and 
its  implementation.  Although  numerous  PBL-related  policy  and  guidance  documents 
exist  at  the  lower  DOD  component  or  services  level,  the  scope  of  this  thesis  focused  on 
the  DOD-level  documents,  as  they  are  both  abundant  and  comprehensive  for  the  analysis 
performed. 

The  methodology  of  the  research  was  to  develop  a  model  using  a  systems 
engineering  approach  for  a  functional  needs  analysis,  starting  with  the  need,  “Implement 
PBL,”  thus  generating  a  graphic  containing  all  of  the  elements/requirements  needed  to 
implement  PBL.  The  model  was  built  without  referencing  any  current  policy  or  guidance 
documents  so  as  not  to  inject  any  bias.  The  model  decomposed  each  high  level  functional 
need  down  to  the  appropriate  lowest  level  in  order  to  capture  all  pertinent  functions 

required  to  enable  implementation  of  the  PBL  concept.  This  model  is  presented  for  each 
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of  the  reviewed  documents  to  aid  readers  through  each  document  analysis  and  identify 
areas  where  policy  refinement  and  additional  guidance  may  improve  understanding  and 
awareness  of  PBL. 

With  the  aid  of  the  model,  information  gaps  that  could  hinder  effective  PBL 
implementation  were  identified  for  each  of  the  reviewed  documents.  The  model  presented 
a  graphic  depiction  of  where  each  of  the  documents  was  deficient  by  highlighting  the 
inadequately  addressed  element  in  red.  In  a  few  instances,  an  element  was  mentioned  but 
the  document  failed  to  address  it  in  a  useful  manner  for  employing  PBL.  These  element 
boxes  were  highlighted  in  yellow.  All  elements  that  were  adequately  addressed  were 
highlighted  in  green.  Five  of  the  six  reviewed  documents  contained  informational  gaps. 
Only  the  PBL  Guidebook  (2014)  addressed  all  of  the  elements  in  the  model,  thus 
identifying  that  document  as  the  single  best  source  of  information  for  PBL. 

Recommendations  were  made  in  this  thesis  for  closing  the  identified  information 
gaps  with  the  aim  to  strengthen  PBL  policies  and  procedures.  Each  identified  gap  is 
accompanied  with  a  corresponding  recommendation  to  correct  or  improve  the  deficiency. 

Major  findings  that  trended  across  several  of  the  reviewed  documents  or  posed 
significant  problems  for  implementing  PBL  were  also  addressed  with  recommendations. 
The  three  major  findings  included  inconsistencies  between  PBL  policy  and  guidance 
documents,  the  need  for  determining  applicability  or  feasibility  of  PBL,  and  lack  of 
sufficient  examples  of  PBL.  The  first  major  finding  is  especially  troublesome.  Three  of 
the  four  policy  documents  direct  the  use  of  PBL.  The  one  remaining  policy  document  and 
two  guidebooks  indicate  that  PBL  may  not  be  appropriate  for  all  product  support  needs. 
Without  clear  and  unequivocal  direction  on  whether  PBL  is  mandatory  or  not,  it  is 
confusing  and  difficult  to  understand  whether  program  managers  and  product  support 
managers  will  be  held  accountable  for  employing  PBL.  Thus,  unless  changes  are  made, 
existing  DOD  policies  and  guidance  do  not  provide  a  clear  path  to  enable  PBL 
implementation. 

Additional  research  topics,  that  were  either  beyond  the  scope  of  this  thesis  or  were 
discovered  during  this  research,  were  recommended  for  future  exploration.  The  desired 


xiv 


result  of  the  research  performed  in  this  thesis  is  to  improve  existing  PBL  policy  and 
guidance  in  order  to  ultimately  provide  affordable  and  effective  weapons  systems  in  the 
defense  of  our  nation. 
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I.  INTRODUCTION 


A.  CONCEPT 

The  objective  of  this  thesis  is  to  identify  and  seek  to  improve  potential  areas 
where  policy  and  guidance  could  be  strengthened  or  clarified  to  improve  implementation 
of  PBL  in  the  future.  This  thesis  analyzes  the  documentation  and  policies  that  currently 
exist  governing  the  implementation  of  performance  based  logistics  (PBL)  to  Department 
of  Defense  (DOD)  acquisitions.  The  analysis  utilizes  a  new  model  to  review  the 
comprehensiveness,  adequacy  and  applicability  of  policies,  guidance,  and  documentation 
that  address  the  implementation  of  PBL  based  system  support. 

This  thesis  explores  the  concepts,  guidance,  and  policies  that  aim  to  help  DOD 
acquisition  program  managers  and  logisticians  effectively  implement  PBL  in  weapon 
systems  acquisitions.  In  addition,  future  areas  of  research  that  may  also  help  improve  or 
facilitate  implementation  of  PBL  across  DOD  weapon  systems  are  proposed. 

B.  BACKGROUND 

In  order  to  understand  what  PBL  is  and  how  it  works,  it  is  critical  to  understand 
that  PBL  has  been  the  DOD’s  preferred  strategy  to  obtain  product  support  since  the 
Quadrennial  Defense  Review  report  of  2001  (Department  of  Defense  2001).  It  is  also 
important  to  note  that  planning  for  product  support  happens  throughout  a  system’s  life 
cycle,  not  just  at  the  point  of  delivery  to  the  warfighter.  This  section  will  define  product 
support  and  explain  why  product  support  planning  throughout  a  system’s  life  cycle  is 
paramount. 

Product  support  is  a  significant  portion  of  a  weapon  system’s  total  life  cycle. 
DODD  5000.01  (2007)  continues  to  state: 

The  Program  Manager  (PM)  shall  be  the  single  point  of  accountability  for 
accomplishing  program  objectives  for  total  life  cycle  systems 
management,  including  sustainment... PM s  shall  consider  supportability, 
life  cycle  costs,  performance,  and  schedule  comparable  in  making 
program  decisions.  Planning  for  Operations  and  Support  and  the 
estimation  of  total  ownership  costs  shall  begin  as  early  as  possible. 
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Supportability,  a  key  component  of  performance,  shall  be  considered 
throughout  the  system  life  cycle.  (Under  Secretary  of  Defense  (AT&L) 

2007,  10) 

Figure  1  is  taken  from  the  PBL  Guidebook  (2014),  published  by  the  office  of  the 
Assistant  Secretary  of  Defense  for  Logistics  and  Materiel  Readiness  (ASD  (L&MR)).  It 
shows  the  phases  of  the  DOD  Acquisition  process  and  when  key  logistics  support 
planning  events  and  milestones  occur  in  relation  to  it.  This  highlights  in  a  weapon 
system’s  development  how  early  supportability  must  be  considered  in  order  to  reduce  life 
cycle  cost  and  logistical  impacts.  Supportability  is  built  into  the  system  during  the  “Plan 
for  support”  and  “Design  for  support”  phases  of  the  life  cycle.  It  can  be  difficult  and 
costly  to  change  or  improve  supportability  after  the  design  is  finalized  in  most  cases 
(Secretary  of  Defense  2014).  Thus,  it  is  critical  to  ensure  that  supportability  is  adequately 
addressed  during  a  weapon  system’s  design  phases. 
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Figure  1.  Key  Support  Activities  by  Phase 
(from  Department  of  Defense  2013,  17) 
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Although  the  PM  has  life  cycle  management  responsibility  of  a  system,  a  Product 
Support  Manager  (PSM)  helps  the  PM  build  a  strategy  for  supporting  the  system.  The 
PSM  Guidebook  (2011)  states: 

In  2009,  Congress  officially  established  the  PSM  as  a  key  leadership 
position,  distinct  from  the  PM,  who  reports  directly  to  the  PM  for  ACAT  1 
and  2  programs.  The  PM  is  charged  with  delivering  Warfighter  required 
capabilities  while  the  PSM,  working  for  the  PM,  is  responsible  for 
developing  and  implementing  a  comprehensive  product  support  strategy 
and  for  adjusting  performance  requirements  and  resource  allocations 
across  Product  Support  Integrators  (PSIs)  and  Product  Support  Providers 
(PSPs)  as  needed  to  implement  this  strategy.  (ASD  (L&MR)  2011b,  11) 

Figure  2  is  provided  to  show  the  roles,  relationships,  responsibilities  and  business 
agreements  among  the  various  key  product  support  stakeholders. 


Figure  2.  Key  Product  Support  Stakeholders  (from  ASD  (L&MR)  2011b,  17) 


Product  support  is  the  sustainment  aspect  of  the  Operations  and  Support  phase  in 
a  weapons  systems  life  cycle.  It  is  further  defined  as: 

Product  Support,  a  key  life  cycle  management  enabler,  is  the  package  of 
support  functions  required  to  deploy  and  maintain  the  readiness  and 
operational  capability  of  major  weapon  systems,  subsystems,  and 
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components,  including  all  functions  related  to  weapon  systems  readiness. 

The  package  of  product  support  functions  related  to  weapon  system 
readiness  and  which  can  be  performed  by  both  public  and  private  entities 
includes  the  tasks  that  are  associated  with  the  Integrated  Product  Support 
(IPS)  Elements.  These  elements  are  an  expansion  of  the  Integrated 
Logistics  Support  (ILS)  elements  and  should  be  considered  during  the 
development,  implementation,  and  subsequent  revalidation  of  the  product 
support  strategy.  Product  support  and  system  engineering  activities  must 
be  integrated  to  deliver  an  effective  and  affordable  product  support 
package.  PSM  involvement  early  in  design  is  a  critical  part  of  ensuring  a 
supportable  and  affordable  system.  (ASD  (L&MR)  2011b,  10) 

Operating  and  Support  (O&S)  costs  frequently  comprise  about  60-70%  of  a 
weapon  system’s  life  cycle  costs  (ASD  (L&MR),  2011b).  Ligure  3  is  an  illustration  of  the 
various  costs  associated  with  each  phase  of  a  weapon  system’s  life  cycle.  Note  that,  on 
average,  the  O&S  phase  of  a  life  cycle  typically  costs  the  greatest  of  all  phases,  with 
some  exceptions.  Hence,  it  is  important  to  seek  and  employ  optimal  management 
techniques  and  support  concepts,  such  as  a  PBL  approach,  to  lower  O&S  expenditures 
and  effectively  make  our  systems  more  affordable. 

Ligure  4  is  included  to  show  selected  system  types  and  their  respective  O&S  costs 
as  a  percentage  of  their  total  life  cycle  costs.  Notice  in  Ligure  4  that  space  systems,  as  an 
exception,  typically  have  significantly  lower  O&S  costs,  at  about  15%  of  total  life  cycle 
costs  (Secretary  of  Defense  2014,  2-2).  Space  systems,  such  as  satellites  and  associated 
command  and  control  systems,  have  high  development  costs  attributed  to  complex 
technological  requirements  for  operating  in  space  (Sellers,  2005).  More  specifically, 
sustainment  costs  for  space  systems  are  relatively  small  in  proportion  to  development  and 
procurement  costs  mainly  because  much  of  a  space  system’s  upkeep  is  accomplished 
through  operations.  “Linally,  in  addition  to  their  training,  commanding,  and  data  handling 
duties,  the  operations  team  must  also  maintain  the  operations  systems  that  support  them, 
such  as  the  complex-communication  networks  that  keep  them  in  touch  with  their 
spacecraft.  This  effort  involves  routine  maintenance  at  remote-tracking  sites,  upgrades  to 
control-center  hardware  and  software,  and  even  new  relay-satellite  links”  (Sellers  2005, 
640). 
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Figure  3.  System  Life  Cycle  Illustration 
(from  Secretary  of  Defense  2014,  2-1) 
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Figure  4.  O&S  Costs  as  Percentage  of  Total  Life  Cycle  Cost  for  Various 
System  Types  (from  Secretary  of  Defense  2014,  2-1) 


As  mentioned  previously,  the  O&S  phase  is  typically  the  most  expensive  for 

DOD’s  weapon  systems.  By  using  innovative  processes,  concepts,  and  methods,  such  as  a 

PBL  approach,  it  is  possible  to  either  improve  a  system’s  reliability/availability,  reduce 
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cost  of  support,  or  a  combination  thereof.  For  the  purposes  of  this  thesis,  any  mention  of 
cost  reduction  will  refer  to  the  reduction  of  support  costs  due  to  application  of  innovative 
processes,  concepts  and  methods  to  reduce  the  cost  of  support  while  maintaining  or 
improving  current  supportability. 

Traditionally,  DOD  policies  and  practices  of  sustainment  have  focused  on 
procurement  of  parts,  services  and  other  logistics  requirements  in  sufficient  quantities  to 
ensure  maximum  availability  of  the  supported  system.  This  is  commonly  referred  to  as  a 
transaction-based  support  system  (Gansler  and  Lucyshyn  2006). 

This  meant  that  DOD  customers  (military  services  and  agencies)  focused 
on  ensuring  that  they  had  enough  spare  parts  and  inventory  to  meet  any 
need  or  requirement  (often  referred  to  as  a  “just  in  case”  system).  This 
approach  tended  to  increase  demand  (the  whiplash  effect),  compounded  by 
a  “supply  push,”  resulting  in  large  inventories.  The  customer  also  bore  the 
costs  and  risks  for  forecasting,  ordering  and  maintaining  inventory, 
warehousing,  managing  obsolescence,  transportation,  reliability  analysis, 
configuration  management  and  field  engineering.  (Gansler  and  Lucyshyn 
2006,  3) 

Though  this  approach  worked  for  the  DOD  in  the  Cold  War  era,  this  is  not  the 
most  cost-effective  way  of  supporting  systems  in  general.  During  recent  times,  as  the 
world’s  major  super  power,  the  United  States  (U.S.)  and  its  armed  forces  has  not  faced  a 
conventional  threat  such  as  the  Soviet  Union  in  the  Cold  War.  The  U.S.  armed  forces 
today  face  a  nonconventional  threat  and  are  more  likely  to  encounter  new  conflicts  waged 
against  different  adversaries  in  challenging  environments  across  the  globe.  This  means 
the  previous  support  strategy  of  amassing  large  inventories  of  spares  to  cover  required 
repairs  is  no  longer  efficient  or  effective. 

Presently,  DOD  and  its  military  branches  are  transitioning  logistics  support  from 
transaction  based  methods  to  PBL  as  the  preferred  method  of  product  support  for  the  21st 
century  (ASD  (L&MR)  2014).  Emphasis  is  now  given  to  consideration  of  logistics  early 
in  the  acquisition  life  cycle  and  consideration  of  product  support  strategies  and 
techniques  that  will  result  in  a  lower  total  life  cycle  cost  and  improved  sustainment 
performance  parameters. 
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The  origin  of  PBL  in  DOD,  or  at  least  statements  implying  a  new  product  support 
strategy,  appeared  as  early  as  1998,  as  articulated  in  Section  912(c)  of  the  National 
Defense  Authorization  Act  (NDAA)  in  the  year  FY  1998  and  the  April  1998  Secretary  of 
Defense  Report  to  Congress:  Actions  to  Accelerate  the  Movement  to  the  New  Workforce 
Vision  in  response  to  Section  912(c)  of  the  NDAA  for  FY  1998  (Kobren  2009,  259).  PBL 
was  originally  a  commercial  approach  to  providing  aircraft  readiness  for  commercial 
jetliners  (ASD  (L&MR)  2014,  8).  “The  Services  originally  implemented  PBL  to  improve 
system  readiness.  More  recently,  PBL  has  been  implemented  to  deliver  needed  reliability 
and  availability,  reduce  total  cost,  and  encourage  and  reward  innovative  cost  reduction 
initiatives”  (ASD  (L&MR)  2014,  9). 

Other  highlights  critical  to  the  establishment  of  PBL  are  captured  by  Bill  Kobren, 
as  he  states,  “The  FY  1998  NDAA  became  the  basis  for  the  July  1999  Product  Support 
for  the  21st  Century  (PS21)  report,  where  it  documented  the  DOD’s  integrated  strategy  to 
implement  reengineered  product  support  processes.  Follow-up  PS21  reports  were 
published  in  2000  and  2001.  The  September  2000  PS21  report  highlighted  the  results  of 
efforts  mentioned  in  previous  reports,  summarized  completed  actions  to  address 
structural  issues,  and  identified  remaining  tasks  and  milestones.  A  year  later,  the 
November  2001  PS21  resulted  in  the  new  document,  A  Program  Manager’s  Guide  to 
Buying  Performance”  (Kobren  2009,  259). 

PBL  guidance  was  also  codified  in  the  May  2003  DOD  Directive  5000.01, 

The  Defense  Acquisition  System,  and  DOD  Instruction  5000.02, 
Operation  of  the  Defense  Acquisition  System.  It  was  further  supported  by 
detailed  implementation  guidance  contained  in  Chapter  5  of  the  Defense 
Acquisition  Guidebook  (DAG)  in  2006,  the  issuance  of  Performance 
Based  Logistics:  A  Program  Manager’s  Product  Support  Guide  in  March 
2005,  and  numerous  related  Office  of  the  Secretary  of  Defense  (OSD)  and 
Service  policies,  instructions,  regulations,  and  guidebooks.  (Kobren  2009, 

259) 

Training  was  also  created  to  help  implement  PBL.  “At  OSD  direction,  DAU  also 
created  a  series  of  PBL-related  learning  courses,  including  Continuous  Learning  Module 
(CLM  011)  Perfonnance  Based  Logistics  (PBL),  LOG  235A  (now  LOG  235)  Web-based 
PBL  training,  LOG  235B  (now  LOG  236)  case-based  classroom  PBL  training,  and 
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establishment  of  the  Web-based  PBL  toolkit  (https://acc.dau.mil/pbl)  in  2005”  (Kobren 
2009,  259). 

The  DOD  looked  to  the  Defense  Acquisition  University  (DAU)  for  help  in 
implementing  PBL.  As  DAU’s  Bill  Kobren  noted,  “consistent  with  the  Defense  Business 
Board  recommendation  to  leverage  DAU  to  accelerate  PBL  implementation  and  to 
establish  a  DOD  PBL  Center  of  Excellence”  (DAU  2005),  the  Assistant  Deputy  Under 
Secretary  of  Defense,  Logistics  Plans  and  Programs  designated  DAU  as  a  PBL  “Center  of 
Excellence”  (DAU  2005)  to  expand  PBL  learning  assets,  performance  support, 
workshops,  rapid  deployment  training,  and  “serve  as  a  nexus  for  information  cross-flow, 
liaison,  and  interface  between  and  among  the  DOD  components,  the  Defense  Industry, 
and  other  Academic  institutions  on  PBL  applications  and  thought  leadership”  (Kobren 
2009,  259). 

To  encourage  increased  implementation  of  PBL,  DOD  sought  to  incentivize  PBL 
implementers.  DAU’s  Bill  Kobren  noted  this  by  stating,  “In  fact,  the  Office  of  the  Under 
Secretary  of  Defense  for  Acquisition,  Technology  and  Logistics  (USD  (AT&L))  was  so 
serious  about  implementing  PBL,  the  USD  (AT&L)  established  an  annual  DOD-level 
awards  program  in  2005  to  recognize  outstanding  system,  sub-system,  and  component- 
level  PBL  strategies  across  the  DOD.  This  compendium  of  policies,  guidance,  initiatives, 
training  structures,  and  program  recognition  attests  to  the  fact  that  PBL  is  clearly  not  a 
passing  fad”  (Kobren  2009,  259). 

The  definition  of  PBL  differs  slightly  as  defined  by  various  sources.  Here  are  two 
comprehensive  examples: 

DAU’s  Performance  Based  Logistics:  A  Program  Manager’s  Product  Support 
Guide  (2005),  defines  PBL  as  “the  purchase  of  support  as  an  integrated,  affordable, 
performance  package  designed  to  optimize  system  readiness  and  meet  perfonnance  goals 
for  a  weapons  system  through  long-term  support  arrangements  with  clear  lines  of 
authority  and  responsibility”  (DAU  2005,  1-1). 

According  to  the  PBL  Guidebook,  published  by  ASD  L&MR  in  May  2014  “PBL 
is  synonymous  with  performance-based  life  cycle  product  support,  where  outcomes  are 
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acquired  through  performance-based  arrangements  that  deliver  Warfighter  requirements 
and  incentivize  product  support  providers  to  reduce  costs  through  innovation.  These 
arrangements  are  contracts  with  industry  or  intra-governmental  agreements”  (ASD 
(L&MR)  2014,  8). 

PBL’s  key  tenets  are: 

•  It  is  a  performance  (outcome)  based  arrangement — this  tenet  can  be 
restated  as  an  expectation  of  seeing  a  desired  outcome  based  on  industry/ 
support  provider’s  innovation/decision  making.  This  entails  allowing  the 
support  provider  to  make  internal  decisions  on  how  to  meet  perfonnance 
objectives  (ASD  (L&MR)  2014). 

•  It  incentivizes  the  support  provider  to  enhance  performance  or  reduce 
the  cost/schedule  of  the  effort  to  maintain  performance — this  tenet  ties 
support  provider  profits  or  process  efficiencies  with  increased  readiness 
and,  in  some  cases,  a  reduced  logistics  footprint  and  lower  costs.  The  other 
side  of  this  tenet  also  exposes  government  agencies  owning  the  system  to 
a  degree  of  risk  based  on  the  technical  maturity  of  the  system  (ASD 
(L&MR)  2014).  Do  we  have  policies  specifying  at  what  technical  maturity 
is  PBL  good  to  use?  Or  on  systems  with  no  precedent,  do  we  have 
policy/guidance  that  specifies  how  to  calculate  potential  risks  against  cost 
savings? 

•  Performance  is  measured  by  appropriate  quantifiable  metrics — this 
tenet  addresses  the  use  of  appropriate  metrics,  as  examples,  system  or 
component  availability,  logistics  lead  time,  mean  time  between  failure,  or 
mean  time  to  restore  functionality.  The  chosen  metrics  and  associated 
performance  targets  should  be  set  to  be  within  the  support  provider’s 
capabilities  and  scope  of  responsibility/influence  (ASD  (L&MR)  2014). 

•  PBL  arrangements  are  typically  long  term  arrangements — this  tenet 
identifies  the  concept  that  in  order  for  a  support  provider  to  want  to  invest 
up-front  to  better  meet  performance  goals,  the  arrangement  should  allow 
enough  time  for  innovations  and  improved  efficiencies  to  take  effect  and 
pay  off.  In  other  words,  if  the  arrangement  is  only  for  two  years,  for 
example,  a  support  provider  will  more  likely  be  less  willing  to  invest 
significant  capital  or  resources  to  improve  processes  or  material  to 
increase  performance,  especially  if  they  know  that  in  two  years  they  could 
potentially  lose  the  work.  They  will  also  have  less  time  to  reap  the  rewards 
of  any  improvements,  thus  reducing  their  incentive  or  profit  potential. 
Therefore,  shorter  term  duration  arrangements  can  expect  to  see  less 
investment  and  innovation,  or  status  quo.  In  contrast,  longer  term 
arrangements,  like  five  years  or  more,  may  encourage  support  providers  to 
invest  and  innovate  more  up-front,  which  would  benefit  the  end  user  with 
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better  system  readiness  and  increase  the  provider’s  profits  by  reducing 
their  costs  over  the  duration  of  the  arrangement.  Lastly,  longer  term 
arrangements  may  allow  for  an  environment  where  a  relationship  of  trust 
and  an  understanding  of  customer  expectations  between  the  PSM  and  PSP 
can  be  established  and  built  over  time  (ASD  (L&MR)  2014). 

In  the  last  15  years  or  so,  the  DOD  has  introduced  many  new  initiatives  to  move 
away  from  traditional  support  strategies  in  order  to  encourage  implementation  of  PBL. 
The  following  documents  are  the  most  recent  and  important  sources  for  guidance 
addressing  PBL  and  its  implementation  in  the  DOD.  A  detailed  analysis  of  the  PBL- 
related  content  of  the  documents  listed  below  will  be  performed  in  Chapter  IV  of  this 
thesis.  These  important  documents  supporting  implementation  of  PBL  in  the  DOD  are  as 
follows: 


•  DODD  5000. 01  (November  20,  2007) 

•  DODI 5000. 02  (January  7,2015) 

•  USD  (AT&L)  Memorandum  “ Better  Buying  Power  3. 0 ”  (April  9,  20 1 5) 

•  ASD  (L&MR)  PBL  Comprehensive  Guidance  (November  22,  2013) 

•  ASD  (L&MR)  PBL  Guidebook  (May  27,  2014) 

•  ASD  (L&MR)  Product  Support  Manager  Guidebook  (April  2011) 

C.  RESEARCH  OBJECTIVES 

The  research  objectives  of  this  thesis  are  as  follows: 

•  Conduct  an  in-depth  analysis  of  the  documentation  and  policies  that 
currently  exist  governing  the  implementation  of  PBL  to  DOD  acquisitions. 

•  Identify  the  significant  gaps  in  DOD  policy  and  guidance  documentation 
that  may  be  problematic  for  implementation  of  PBL. 

•  Identify  and  recommend  possible  changes  to  policy  and  guidance  that 
could  help  improve  implementation  of  PBL  by  DOD  logisticians  and 
program  managers. 
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D.  RESEARCH  QUESTIONS 

The  research  in  this  thesis  addresses  and  strives  to  provide  answers  to  the 
following  questions: 

•  Are  current  and  applicable  DOD  policy  and  guidance  documents  adequate 
to  facilitate  PBL  implementation? 

•  What  informational  gaps  exist  in  the  current  DOD  policies  and  guidance 
that  may  pose  issues  for  implementing  PBL? 

•  What  changes  and  recommendations  can  be  proposed  to  close  these 
informational  gaps  to  better  assist  DOD  program  managers  and 
logisticians  in  implementing  PBL? 

E.  ASSUMPTIONS,  SCOPE  AND  LIMITATIONS 

The  following  assumptions  were  made  in  this  thesis  for  the  purpose  of  controlling 
scope  and  identifying  limitations  in  order  to  maintain  objectivity  of  the  research 
performed: 

•  This  thesis  assumes  that  the  reader  understands  the  basic  principles  and 
policies  governing  DOD  system  acquisition  in  general. 

•  This  thesis  does  not  intend  to  evaluate  the  effectiveness  of  PBL  in  meeting 
its  intended  goals  (e.g.,  reducing  support  costs,  decreasing  logistics 
footprint,  or  increasing  system  availability/sustainability).  This  thesis  is  a 
comprehensive  evaluation  of  the  policies,  guidance,  and  documentation 
pertinent  to  PBL  that  can  improve  and  standardize  the  implementation  of 
PBL  by  program  managers  and  product  support  managers  across  the 
DOD. 

•  Resource  requirements  needed  to  implement  PBL,  such  as  sufficient 
funding  in  correct  appropriation  types,  are  out  of  scope  of  this  thesis,  as  it 
is  normally  provided  by  DOD  via  the  Program  Objective  Memorandum 
(POM)  process,  as  needed.  Fiscal  constraints  are  a  real  concern  facing  the 
DOD  today,  but  are  not  a  factor  for  the  discussion  of  whether  PBL  is 
adequately  addressed  and  covered  in  DOD  policies  and  guidance 
documents.  On  the  other  hand,  guidance  on  funding  issues  and  strategies, 
like  paying  into  a  Working  Capital  Fund  or  utilizing  Life  Cycle  Cost 
(LCC)  estimates,  are  essential  to  implementing  PBL  and  will  be 
considered. 

•  The  thesis  assumes  that  the  PBL  implementation  model  developed  by  the 
author  is  new  to  readers.  Therefore,  Chapter  III  will  provide  a  thorough 
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explanation  of  the  model  and  how  it  is  used  for  evaluating  the  policies  and 
guidance. 

•  A  gap  review  of  only  the  most  recent,  available  and  pertinent  DOD 
policies  and  guidance  with  respect  to  PBL  will  be  presented.  New  or 
updated  policies  or  guidance  on  PBL  may  have  emerged  since  publication 
date  of  this  thesis. 

•  This  thesis  will  identify  any  informational  gaps  that  may  hinder  product 
support  managers  from  effectively  implementing  PBL. 

•  This  thesis  will  provide  recommendations  to  improve  the  effectiveness  of 
DOD  documentation  toward  the  goal  of  implementing  PBL. 

F.  ORGANIZATION 

This  thesis  is  organized  as  follows:  Chapter  II  provides  the  approach  used  to 
review  and  identify  any  infonnational  gaps  that  may  hinder  implementation  of  PBL.  In 
Chapter  III,  this  thesis  describes  a  model  that  was  developed  by  the  author  based  on  a 
systems  engineering  approach  of  developing  a  functional  diagram.  This  model  provides  a 
framework  upon  which  each  policy  and/or  guidance  document  reviewed  in  this  thesis  can 
be  assessed  for  possible  informational  gaps  that  could  inhibit  effective  implementation  of 
PBL.  Chapter  IV  reviews  each  of  the  policy  and  guidance  documents  selected  pertaining 
to  PBL  implementation  to  identify  any  potential  informational  gaps  and  provide 
recommendations  for  modifying  the  documents  to  better  assist  in  implementation  of  PBL. 
Finally,  Chapter  V  concludes  with  major  findings  resulting  from  the  research  performed 
and  also  proposes  future  areas  of  research  that  could  further  improve  the  implementation 
of  PBL. 
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II.  APPROACH 


A.  DESIGN 

In  order  to  conduct  a  gap  analysis  of  the  current  guidance  and  documentation 
regarding  the  DOD’s  implementation  of  PBL  in  Chapter  IV,  this  thesis  first  proposes  a 
systematic  PBL  implementation  model,  which  is  further  described  in  Chapter  III.  This 
model  is  used  to  assess  the  completeness  of  the  selected  current  policy  and  guidance 
documents  and  identify  any  infonnational  gaps  that  may  exist.  Once  these  gaps  have 
been  identified,  recommendations  will  be  provided  on  ways  to  bridge  these  gaps  as 
appropriate.  This  approach  does  not  involve  the  study  of  any  individuals  or  organizations, 
but  instead  will  be  based  on  critical  analysis  and  review  of  selected  current  DOD  policies 
and  guidance  documents.  The  documents  chosen  for  analysis  can  all  be  found  on  the  PBL 
Community  of  Practice  website  on  Defense  Acquisition  University’s  Acquisition 
Community  Connection  website  at  https://acc.dau.mil.  It  should  be  noted  that  all  PBL 
policy  and  guidance  reviewed  in  this  thesis  is  at  the  DOD  level  and  not  at  the  component 
service  level  (i.e.,  Army,  Air  Force,  or  Navy)  because  the  amount  of  DOD  level 
documentation  was  found  to  be  abundant  and  appropriate  for  the  scope  of  this  thesis.  The 
documents  reviewed  in  Chapter  IV  are  organized  into  two  groups:  Policies  and 
Guidebooks.  The  documents  are  as  follows: 

•  DODD  5000. 01  (November  20,  2007)  (Policy) 

•  DODI 5000. 02  (January  7,2015)  (Policy) 

•  USD  (AT&L)  Memorandum  “ Better  Buying  Power  3.0 ”  (April  9,  2015) 
(Policy) 

•  ASD  (L&MR)  PBL  Comprehensive  Guidance  (November  22,  2013) 
(Policy) 

•  ASD  (L&MR)  PBL  Guidebook  (May  27,  2014)  (Guidebook) 

•  ASD  (L&MR)  Product  Support  Manager  Guidebook  (April  2011) 
(Guidebook) 
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B. 


DESCRIPTION  OF  PBL  IMPLEMENTATION  MODEL 


The  PBL  implementation  model  presented  in  this  thesis  provides  the  underlying 
structure  for  the  analysis  of  each  of  the  policy  and  guidance  documents.  This  model  was 
developed  with  a  systems  engineering  approach  by  creating  a  functional  needs  analysis, 
starting  with  the  need,  “Implement  PBL.”  This  model  was  built  without  referencing  any 
current  policy  or  guidance  documents  so  as  not  to  inject  any  bias.  The  model  decomposed 
each  high  level  functional  need  down  to  the  appropriate  lowest  level  in  order  to  capture 
all  pertinent  functions  required  to  enable  implementation  of  the  PBL  concept.  The  visual 
representation  of  the  PBL  implementation  model  was  built  using  Microsoft  Visio. 

C.  HYPOTHESIS 

There  are  significant  information  gaps  in  documentation  of  PBL  policy  and 
guidance  that  hinder  comprehensive  implementation  across  the  DOD. 

D.  PROCEDURE 

In  Chapter  III,  the  PBL  analysis  model  is  presented  as  the  framework  for 
assessing  each  selected  policy  and/or  guidance  document.  In  Chapter  IV,  this  thesis  will 
review  in  depth  the  selected  policies  and  guidance  literature  and  identify  informational 
gaps  for  each  of  the  elements  represented  in  our  PBL  analysis  model.  This  thesis  will  also 
include  a  graphical  representation  of  each  of  the  model  elements  that  are  not  addressed  or 
contained  in  each  document.  Each  document  used  in  this  thesis  was  organized  in  Chapter 
IV  into  two  groups  by  whether  it  was  a  policy  document  or  a  reference  guidebook. 
Possible  ways  to  fill  the  informational  gaps  for  each  group  of  documents  will  be 
identified  and  recommended.  Finally,  recommendations  and  conclusions  are  presented  in 
Chapter  V  to  summarize  the  major  findings  and  suggest  further  areas  of  research. 
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III.  PBL  IMPLEMENTATION  MODEL 


A.  BACKGROUND  ON  PBL  IMPLEMENTATION  MODEL 

This  chapter  explains  the  concept  and  methodology  used  to  create  the  PBL 
implementation  model  and  how  it  aids  in  assessing  the  efficacy  and  thoroughness  of  the 
selected  DOD  PBL  policy  and  guidance  documents.  This  model  was  developed  to  help 
guide  the  reader  in  understanding  what  is  required  to  implement  PBL  and  whether  it  is  or 
is  not  addressed  in  current  DOD  policies  or  guidance  documents.  It  also  provides  a  means 
to  graphically  depict  the  critical  functions  or  requirements  in  PBL  and  physically  identify 
shortfalls  or  gaps  in  these  policies  and  guidance  documents. 

To  build  the  model,  a  systems  engineering  process,  called  functional  analysis,  was 
used  to  decompose  the  overarching  function,  “Implement  PBL.”  By  means  of  functional 
decomposition,  basic  functions  critical  to  implementing  PBL  were  systematically 
identified.  These  critical  functions  (1.1  through  1.6  in  the  model)  were  generated 
logically  identifying  the  absolute  essential  functions/needs  for  implementing  PBL,  as 
well  as  the  author’s  personal  knowledge,  experience  and  understanding  of  PBL.  In 
essence,  PBL  may  not  successfully  or  meaningfully  be  implemented  without  a  majority, 
if  not  all,  of  these  fundamental  functions.  These  critical  functions  were  further 
decomposed  to  identify  lower-level  functions  which  all  support  the  associated  higher- 
level  function.  Through  this  process  of  identifying  key  functions  and  sub-functions,  a 
visual  model  emerged  that  could  be  used  to  assess  whether  a  given  policy  or  guidance 
document  identifies  or  addresses  all,  some  or  none  of  these  functions  and  sub-functions 
necessary  for  implementing  PBL.  Thus,  the  model  serves  as  a  means  to  identify  where 
gaps,  if  any,  exist  in  the  current  DOD  policies  and  guidance  on  PBL. 

It  is  important  to  note  that  this  model  does  not  intend  to  assess  PBL  in  itself.  It  is 
more  so  a  means  of  objectively  identifying  all  functions  and/or  requirements  needed  to 
implement  PBL.  It  focuses  on  what  is  needed  to  implement  PBL,  instead  of  how  PBL 
should  be  implemented.  Accordingly,  in  order  to  objectively  assess  policy  and  guidance, 
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the  model  is  designed  to  identify  what  functions  or  sub-functions  each  policy  or  guidance 
document  addresses  or  not. 

It  is  also  critical  to  understand  that  this  thesis  reviews  both  policy  and  guidance 
documents.  Policy  documents  typically  identify  what  needs  to  be  complied  with  or 
executed.  They  rarefy,  if  ever,  provide  instructions  or  guidance  on  how  to  perform  or 
execute  the  directed  policy.  Guidance  documents,  on  the  other  hand,  supplement  a 
targeted  policy  and  provide  information  on  how  to  comply  with  that  related  policy. 

B.  PURPOSE  OF  MODEL 

The  goal  of  creating  this  model  is  to  identify  and  depict  the  functions  or 
requirements  needed  to  implement  PBL.  Further,  it  intends  to  help  the  reader  readily 
identify  shortfalls  or  gaps  in  the  current  policies  and  guidance  on  PBL  that  are  reviewed 
in  this  thesis.  Each  of  the  policy  or  guidance  documents  reviewed  will  have  an 
accompanying  model  snapshot  that  will  graphically  identify  the  specific  functions  or 
requirements  that  are  not  identified  or  addressed.  The  primary  objective  is  to  identify 
policy  or  guidance  gaps  in  need  of  improvement  to  help  better  enable  successful 
implementation  of  PBL  across  the  DOD. 

C.  MODEL  DESCRIPTION 

This  section  explains  each  of  the  elements  in  the  model,  which  represent  the 
various  functions  and  sub-functions  needed  to  implement  PBL.  The  PBL  implementation 
model  is  shown  in  Figure  5. 
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Figure  5.  PBL  Implementation  Model 
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1 . — Implement  PBL 

With  regard  to  PBL,  Better  Buying  Power  3.0  (2015)  states,  “When  properly 
established  and  executed,  Performance-Based  Logistics  (PBL)  is  an  effective  way  to 
balance  cost  and  perfonnance  regardless  of  whether  industry  or  the  Government  is 
providing  the  logistics  service.  PBL  also  provides  explicit  productivity  incentives  and 
ensures  the  best  value  for  the  DOD,  particularly  for  service  contracts  such  as  maintenance 
and  support  contracts”  (USD  (AT&L)  2015b,  8).  This  element  is  the  starting  point  of  the 
model,  introducing  the  key  action  to  be  addressed,  “Implement  PBL.” 

1.1 —  Provide  Guidance 

In  order  to  put  into  place  any  new  process  or  way  of  doing  business,  leadership 
must  provide  guidance  that  assists  the  organization  in  implementing  it.  Guidance  is  not 
policy.  Policy  tells  what  must  be  done.  Guidance  seeks  to  explain  how  and  why  the  new 
process  is  being  implemented. 

1.1. 1 —  Foster  PBL  Knowledge 

This  element  represents  the  general  concept  of  informing  and  educating  all 
stakeholders  involved  with  product  support  about  what  PBL  is  and  how  to  implement  it. 
PBL  represents  a  new  way  of  obtaining  product  support  that  could  be  difficult  for 
Program  Managers  and  Product  Support  Managers  to  embrace  initially  because  it  is  very 
different  from  the  traditional  transaction-based  support  strategies  they  may  be  more 
familiar  with. 

1.1.1. 1 —  Provide  Instructions  and  Training 

An  important  aspect  of  providing  guidance  is  to  provide  instructional 
publications,  training  materials  and  reference  materials.  All  of  these  materials  and 
documents  are  intended  to  supplement  policy,  law  or  regulations  by  providing  lower  level 
details  to  better  communicate  what  the  regulatory  or  statutory  policies  are  directing.  An 
effective  guidebook  or  set  of  training  materials  can  help  an  organization’s  personnel  to 
better  implement  targeted  policy  or  law  as  envisioned  or  intended  by  the  policy  makers. 
Another  important  aspect  to  remember  about  training  materials  or  other  instructional 
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documents  is,  they  are  written  as  references  or  guidance  and  typically  are  not  directive  in 
nature.  They  merely  provide  additional  information  to  guide  implementers  of  various 
ways  or  methods  of  achieving  the  desired  effects  of  the  policy. 

1.1.1 .2 —  Provide  Examples 

A  powerful  tool  to  help  implementers  of  any  given  policy  is  to  provide  them  with 
examples  of  how  others  in  the  field  have  successfully  implemented  them  in  the  past. 
Simply  describing  a  policy  or  methodology  sometimes  fails  to  adequately  help 
practitioners,  especially  when  a  given  policy  does  not  exactly  apply  to  their  specific 
program  or  system.  As  an  example,  maintenance  on  a  satellite  deployed  in  outer  space 
may  not  be  properly  addressed  by  maintenance  policy  that  is  written  for  terrestrial 
weapon  systems.  Remove  and  replace  procedures  for  hardware  components  for  aircraft  or 
ships  are  not  applicable  to  satellites  that,  once  deployed  into  outer  space,  cannot  be 
physically  repaired  or  accessed  by  maintenance  personnel.  Therefore,  maintenance 
policies  for  space  systems  may  have  to  be  written  more  toward  software  uploads  and 
operations-centric  procedures  to  activate  or  deactivate  components,  vice  physical  remove 
and  repair  procedures  traditionally  performed  on  systems  that  operate  in  Earth’s 
environment.  For  PBL  specifically,  examples  of  how  other  systems  implemented  PBL 
could  be  very  useful  to  help  them  better  understand  the  effectiveness  and  applicability  of 
it  to  their  own  programs. 

1.1.1 .3 —  Foster  Best  Practices/Lessons  Learned 

Best  practices  and  lessons  learned  are  general  guidelines  that  have  been  learned 
through  historical  experiences  or  past  endeavors  that  may  have  resulted  in  success  or 
failure.  These  can  be  very  powerful  and  helpful  to  implementers  of  PBL,  steering 
practitioners  toward  beneficial  activities  or  practices  that  can  improve  chances  of  success. 
Best  practices  can  also  be  derived  from  past  failures  as  well,  informing  of  what  not  to 
implement.  An  example  of  a  best  practice  for  PBL  is,  longer  duration  contracts  or 
agreements  are  encouraged  as  they  allow  enough  time  for  support  providers  to  recover 
any  upfront  capital  investments  they  may  have  made  toward  optimizing  their  support 
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posture,  thus  potentially  increasing  availability  or  dependability  of  a  system  to  the 
warfighter. 

1.1.1 .4 —  Identify  References/Guidance  Documents 

This  element  is  focused  on  whether  references  or  guidance  documents  are 
identified  in  the  policy  or  guidance  document  under  review.  If  there  are  such  reference 
materials  or  guidance  documents  available  in  support  of  any  given  policy  or  guidance, 
simply  referencing  them  and  pointing  implementers  to  them  could  make  the  policy  or 
guidance  much  easier  to  implement.  Similar  to  the  instructional  or  training  materials 
mentioned  in  element  1.1. 1.1,  typically  references  or  guidance  documents  are  not 
directive  in  nature,  but  intend  to  supplement  policy  with  additional  information  that  may 
be  helpful  for  implementation  of  said  policy. 

1.1.1 .5 —  Review/Update  Guidance 

As  with  any  form  of  change,  especially  with  the  evolution  of  something  as 
complex  as  PBL,  there  will  be  changes  along  the  way.  Therefore,  it  is  crucial  that  any 
policy  or  guidance  document  be  updated  regularly  to  stay  abreast  of  any  changes  or 
improvements.  In  some  cases,  a  document  may  explicitly  state  time  intervals  where  the 
contents  will  be  reviewed  and  updated  for  currency. 

1.2 — Publish  Policy 

This  is  simply  communicating  or  publishing  the  actual  policy  that  leadership 
wants  to  effect.  This  element,  and  its  subordinate  element,  1.2.1,  only  apply  to  the  policy 
documents  reviewed  in  this  thesis. 

1.2.1 — Review/Update  Policy 

It  is  self-evident  that  policy  must  be  clear  and  current.  With  respect  to  PBL,  which 
is  a  constantly  evolving  concept,  policy  must  also  adapt  to  ensure  that  it  is  properly 
implemented  as  it  is  intended.  It  is  also  important  that  policy  be  consistent  across  all  of 
the  various  statutory  and  regulatory  documents  that  may  touch  on  PBL.  Some  policy 
documents  also  inherently  incorporate  review/update  schedules. 
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1 .3 — Provide  Resources 


In  general,  resources,  such  as  funding  and  manpower,  are  essential  for 
implementing  PBL.  More  specifically,  the  activity  of  resource  planning  to  ensure  enough 
resources  are  identified  or  available  to  implement  PBL  is  of  concern  with  this  element. 
This  element  does  not  include  activities  regarding  how  a  program  office  will  obtain 
funding  (normally  Operations  and  Maintenance  appropriations)  through  the  Program 
Objective  Memorandum  process  to  fund  sustainment  activities. 

1.3.1 —  Develop  Operating  and  Support  (O&S)  Cost  Estimate 

An  important  aspect  of  resource  planning  for  PBL  is  to  establish  a  cost  estimate  of 
support  for  a  system.  It  can  provide  a  starting  point  for  negotiations  on  cost  of  support  in 
candidate  PBL  contracts  or  arrangements  with  PSPs.  An  O&S  cost  estimate  is 
particularly  important  for  supporting  a  Business  Case  Analysis  (BCA),  which  is 
addressed  in  another  element  in  the  model,  1.5.6,  Perform  Business  Case  Analysis 
(BCA).  The  BCA  will  help  provide  a  decision  on  whether  PBL  is  a  feasible  option  for 
providing  support  to  the  system.  The  DOD’s  O&S  Cost  Estimating  Guide  (2014)  says  a 
BCA  “is  a  structured  approach  to  identify  the  cost,  benefits,  and  risks  of  the  alternatives. 
To  ensure  accurate  results,  the  business  case  analysis  depends  on  O&S  cost  data  as  well 
as  requirements  and  supportability  analysis  results”  (Secretary  of  Defense  2014,  3-13). 

1.3.2 —  Identify  Bunding  Strategy 

As  part  of  planning  resources  for  PBL,  program  managers  have  to  consider  how 
they  can  provide  funds.  A  major  consideration  is  whether  the  support  will  come  from  an 
organic  or  contractor  source.  If  it  is  from  an  organic  source,  for  example,  a  government 
depot  repair  capability,  then  initial  funding  may  have  to  go  into  a  working  capital  fund. 
Otherwise,  direct  appropriation  would  be  the  method  to  fund  a  contract  when  using 
commercial  support. 

1 .4 — Identify  Stakeholders/Roles 

A  critical  part  of  the  systems  engineering  process  is  to  identify  all  stakeholders 
that  may  be  impacted  by  a  system.  “Systems  engineering  is  a  systematic  process  that 
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includes  reviews  and  decision  points  intended  to  provide  visibility  into  the  process  and 
encourage  stakeholder  involvement.  The  systems  engineering  process  includes 
stakeholders  through  all  stages  of  the  project,  from  initial  needs  definition  through  system 
verification  and  acceptance”  (Ryen  2003,  4).  For  PBL  implementation,  and  product 
support  planning  in  general,  the  key  stakeholders  are  identified  in  Figure  1  in  Chapter  I. 

1 .4. 1 —  Identify  End  User 

In  the  context  of  DOD  weapon  systems  acquisition,  the  end  user  typically  is  the 
warfighter.  It  is  critical  for  acquisition  professionals  to  understand  the  needs  and 
requirements  of  the  warfighter  in  order  to  provide  a  successful  and  effective  weapon 
system.  Once  the  needs  are  understood  and  documented,  maintenance  planning  can  begin 
to  capture  all  requirements  and  maintenance  actions  to  keep  the  system  available  to  the 
warfighter.  PBL  is  intended  to  optimize  system  availability  to  the  warfighter  by  buying 
system  readiness,  rather  than  buying  traditional  transaction-based  maintenance 
processes/procedures  and  excessive  sparing  of  replaceable  items. 

1.4.2 —  Identify  Product  Support  Provider  (PSP) 

The  PSP  is  the  organization  or  entity  that  is  assigned  or  contracted  to  provide 
system  support.  In  other  words,  these  organizations  perform  maintenance  on  the  system, 
as  well  as  other  key  maintenance-related  activities,  such  as  configuration  management, 
supply  chain  management,  and/or  sustaining  engineering. 

1.4.2. 1 —  Identify  Organic  PSP 

The  PSP  may  be  an  organic  or  government  entity  providing  support  for  a  system. 

1.4. 2.2 —  Identify  Contractor  PSP 

The  PSP  may  be  a  commercial  or  contractor  entity  providing  support  for  a  system. 

1.4.3 — Identify  Product  Support  Integrator  (PSI) 

The  Product  Support  Manager  Guidebook  (2011)  states: 

The  Product  Support  Integrator  (PSI)  role  is  assigned  within  the  scope, 

direction,  and  oversight  of  the  Product  Support  Manager  (PSM).  (Note 

that  the  PSI  is  assigned  at  the  discretion  of  the  PSM;  not  all  programs  will 
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require  a  PSI).  PSIs  accomplish  their  product  support  role  through  us  of 
one  or  more  Product  Support  Providers  (PSP).  Product  support  integrators 
are  responsible  for  the  activities  and  output  of  one  or  more  product  support 
providers  within  a  specific  product  support  element  or  across  product 
support  elements.  There  may  be  a  system-level  PSI  that  manages 
subsystem  level  PSIs.  A  PSI  may  also  perform  the  function  of  a  product 
support  provider.  A  PSI  may  be  either  a  government  or  contractor  entity. 

(ASD  (L&MR)  2011b,  20) 

1.4.3. 1 —  Identify  Organic  PSI 

The  PSI  may  be  an  organic  or  government  entity. 

1.4. 3. 2 —  Identify  Contractor  PSI 

The  PSI  may  be  a  commercial  or  contractor  entity. 

1.4.4 —  Identify  Program  Manager  (PM) 

The  PM  is  assigned  Life  Cycle  Management  responsibility  and  is 
accountable  for  the  implementation,  management,  and  oversight  of  ah 
activities  associated  with  development,  production,  sustainment,  and 
disposal  of  a  system  across  its  life  cycle.  As  part  of  this,  the  PM  has  the 
responsibility  to  develop  an  appropriate  sustainment  strategy  to  achieve 
effective  and  affordable  operational  readiness  consistent  with  the 
Warfighter  resources  allocated  to  that  objective.  The  PM’s  responsibilities 
for  oversight  and  management  of  the  product  support  function  are 
typically  delegated  to  a  PSM  who  leads  the  development,  implementation, 
and  top-level  integration  and  management  of  all  sources  of  support  to 
meet  Warfighter  sustainment  and  readiness  requirements.  (ASD  (L&MR) 

2011b,  17-18) 

The  assigned  PM  managing  a  weapon  system  acquisition,  on  behalf  of  the  DOD, 
inherently  a  government  position. 

1.4.5 —  Identify  Product  Support  Manager  (PSM) 

The  Product  Support  Manager  Guidebook  (2011)  states  the  following: 

DOD  recognizes  that  the  Program  Manager  (PM)  has  life  cycle 
management  responsibility.  In  2009,  Congress  officially  established  the 
PSM  as  a  key  leadership  position,  distinct  from  the  PM,  who  reports 
directly  to  the  PM  for  AC  AT  1  and  2  programs.  The  PM  is  charged  with 
delivering  Warfighter  required  capabilities  while  the  PSM,  working  for  the 
PM,  is  responsible  for  developing  and  implementing  a  comprehensive 
product  support  strategy  and  for  adjusting  performance  requirements  and 
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resource  allocations  across  Product  Support  Integrators  (PSIs)  and  Product 
Support  Providers  (PSPs)  as  needed  to  implement  this  strategy. 
Furthermore,  the  PSM’s  responsibility  carries  across  the  life  cycle  of 
the  weapon  system  by  requiring  the  revalidation  of  the  business  case 
prior  to  any  change  in  support  strategy  or  every  five  years,  whichever 
occurs  first.  The  PSM  must  be  a  properly  qualified  member  of  the 
Armed  Forces  or  full-time  employee  of  the  Department  of  Defense. 

(ASD  (L&MR)  2011b,  10) 

1.4.6 — Identify  Supply  Chain  Management 

Supply  Chain  Management,  according  to  the  PSM  Guidebook  (2014),  includes 

sustaining  engineering,  maintenance  and  maintenance  planning,  PHS&T, 
support  equipment,  and  tech  data.  PSMs  should  be  cognizant  of  their 
system’s  supply  chain  from  a  logically  bounded  end-to-end  perspective. 

Supply  chain  management  responsibility  includes  the  distribution,  asset 
visibility,  and  obsolescence  mitigation  for  weapon  system  sustainment 
material.  From  a  Warfighter’s  perspective,  transportation  and  asset 
visibility  have  a  substantial  impact  on  high-level  sustainment  metrics  and 
should  be  emphasized  in  the  product  support  strategy.  All  the  skilled 
labor,  advanced  technology,  and  performance  of  a  modern  weapon  system 
mean  little  without  the  “right  part,  in  the  right  place,  at  the  right  time.” 

(ASD  (L&MR)  2011b,  31-32) 

The  supply  chain  management  function  can  be  performed  by  either  organic  or 
commercial  entities,  depending  on  whichever  option  provides  the  best  value  to  the 
government  and  meets  the  PSM’s  requirements. 

1.5 — Define  PBL  and  its  Elements 

The  concept  and  elements  of  PBL  must  be  thoroughly  understood  before  it  can  be 
implemented  effectively. 

1.5.1 — Determine  Scope/ Applicability  of  PBL 

Current  policy  directs,  “Employ  effective  performance-based  logistics  (PBL) 
planning,  development,  implementation,  and  management  in  developing  a  system’s 
product  support  arrangement”  (USD  (AT&L)  2015a,  113).  However,  the  PBL 
Comprehensive  Guidance  memorandum,  issued  by  ASD  (L&MR)  in  2013,  suggests  that 
maybe  not  all  support  arrangements  may  necessarily  be  appropriate  for  PBL  to  be 
employed.  This  element  addresses  the  question  of  whether  PBL  is  applicable  to  some  or 
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all  product  support  arrangements.  Also,  this  element  identifies  the  question  of  what  scope 
or  set  of  boundaries  should  be  used  for  any  given  PBL  arrangement.  In  other  words,  will 
PBL  work  for  the  entire  system,  or  only  for  lower  level  sub-systems  only,  or  for  specific 
functions  within  the  realm  of  product  support?  For  example,  a  PSM  may  choose  to  apply 
PBL  only  to  a  sub-system  that  contains  mature  and  well  understood  reliability  and  cost 
data.  Or,  the  PSM  may  use  PBL  in  an  arrangement  with  another  entity  to  provide  only 
supply  chain  management  functions,  while  keeping  traditional  contracts  or  arrangements 
for  all  other  product  support  functions. 

1.5.2 — Identify  Goals  of  PBL 

In  order  to  appropriately  apply  PBL  methodologies  and  principles  to  a  product 
support  arrangement,  one  must  understand  what  they  intend  to  achieve  by  doing  so.  For 
example,  is  the  intent  of  using  PBL  to  contain  product  support  costs,  increase  availability 
of  the  system  to  the  warfighter,  lock  in  a  long-tenn  arrangement  with  a  support  provider, 
reduce  the  overall  logistics  footprint,  or  a  combination  of  these  desired  outcomes? 

1.5.2. 1  Improve  Sustainability/RAM 

One  of  the  potential  goals  of  employing  PBL  in  a  product  support  arrangement 
may  be  to  improve  the  overall  sustainability  of  the  system.  This  could  be  achieved  by 
seeking  to  improve  the  system  or  component  reliability,  availability  and  maintainability 
(RAM).  For  example,  identification  of  a  specific  part  or  component  that  may  be  failing  at 
a  higher  rate  than  desired  could  instigate  the  PSP  to  make  engineering  changes  to 
improve  its  reliability,  and  thus,  improve  overall  reliability  of  the  associated  system  or 
subsystem.  This  could,  in  turn,  reduce  maintenance  costs  and  increase  availability  of  the 
system  to  the  warfighter  or  end  user.  In  addition,  in  a  typical  PBL  approach,  especially  in 
a  Finn  Fixed  Price  contract,  the  PSP  could  benefit  from  such  improvements  by  reducing 
their  overall  cost  to  maintain  the  system,  leading  to  more  profit  for  the  PSP.  This 
outcome  is  a  win-win  situation  for  both  the  warfighter  and  the  PSP. 
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1.5. 2.2  Decrease  Logistics  Footprint 

“The  Government/Contractor  size  or  ‘presence’  of  deployed  logistics  support 
required  to  deploy,  sustain,  and  move  a  system.  Measurable  elements  include 
inventory/equipment,  personnel,  facilities,  transportation  assets,  and  real  estate”  (ASD 
(L&MR)  2014,  136).  The  objective  is  to  decrease  overall  logistics  footprint  and  reduce 
support  costs  for  the  system. 

1.5. 2. 3  Reduce  Cost 

One  of  the  goals  with  PBL  is  to  reduce  support  costs.  As  previously  identified  in 
Chapter  I  in  Figure  3,  we  saw  that  O&S  costs  make  up  a  large  amount  of  the  overall  life 
cycle  cost  of  any  given  weapon  system.  Through  any  variety  of  the  PBL  goals  mentioned 
under  1.5.2,  the  potential  reduction  of  cost  to  support  a  given  system  is  highly  desirable, 
especially  in  an  environment  where  the  DOD  is  trying  to  maintain  a  high  posture  of 
national  defense  with  shrinking  budgets. 

1.5. 2.4  Meet  End  User  Requirements 

The  overarching  goal  for  any  weapon  system  is  to  meet  the  needs  of  the  end  user, 
or  warfighter.  The  ultimate  challenge  is  to  do  so  in  a  cost  efficient  and  highly  effective 
manner  to  help  the  DOD  meet  its  national  defense  strategy.  Meeting  warfighter 
requirements  is  made  difficult  by  a  number  of  factors,  which  include  rapid  changes  in 
technology,  the  threats  we  face,  geopolitical  situations,  and  pressures  on  budgets. 

1.5.3  Identify  Incentives 

An  important  tenet  in  PBL  is  the  use  of  incentives  to  elicit  a  favorable  outcome 
for  both  the  warfighter  and  the  product  support  organizations. 

An  incentive  is  anything  that  encourages  or  motivates  somebody  to  do 
something.  With  respect  to  PBL  arrangements,  it  is  any  term  or  condition 
that  encourages  the  desired  product  support  integrator  and/or  provider 
behavior  to  deliver  the  relevant  Warfighter  outcome  (for  aspects  of 
performance  that  are  within  their  control).  The  incentive  may  be  related  to 
contract  type,  contract  length,  or  incentive  fees  (or  penalties).  A  FFP 
contract  provides  the  strongest  incentive  for  the  provider  to  control  costs. 
However,  FFP  contracts  do  not  share  these  savings  with  the  Government, 
and  without  additional  mechanisms  (e.g.,  Contract  Data  Requirements 
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Lists  (CDRLs)),  they  do  not  provide  the  information  needed  by  the 
Government  to  understand  actual  costs  for  negotiations  on  future  PBL 
contracts.  Another  powerful  incentive  is  the  ability  to  receive  extensions 
to  the  duration  of  the  contract  (award  term)  with  good  performance.  This 
provides  stability  to  the  provider’s  order  book  and  adds  shareholder  value. 
Incentives  that  focus  on  profit  may  not  be  applicable  for  public  facilities, 
but  increased  percentage  of  available  workload,  promotions,  bonuses,  and 
spot  awards  are  all  possible  incentives  along  with  the  desire  to  positively 
impact  Warfighter  outcomes.  Whatever  form  the  incentive  takes,  it  should 
be  sufficient  to  ensure  the  desired  behavior  and  outcome  over  a  range  of 
conditions.  (ASD  (L&MR)  2014,  1 14) 

1.5.4  Identify  Metrics 

Metrics  are  another  important  tenet  in  implementing  PBL  effectively. 

Performance  metrics  are  vital  to  the  success  of  a  PBL  arrangement.  The 
Government  needs  insight  into  program  performance  to  determine 
compliance  with  performance  requirements  and  level  of  mission  success. 

For  example,  one  important  area  to  gather  measurement  data  is  related 
supply  chain  performance,  as  these  are  associated  with  key  perfonnance 
indicators  such  as  materiel  availability  and  operations  and  support  costs. 

The  PSM  is  responsible  for  the  performance  of  the  product  support 
solution  and  will  use  Warfighter  relevant  metrics  to  monitor  its 
performance.  Metrics  assigned  to  the  PSI  or  PSP  reflect  the 
responsibilities  assigned  to  them.  They  should  not  reflect  outcomes  that 
are  beyond  the  PSI/PSP  ability  to  influence  and  are  not  part  of  the 
arrangement.  The  selected  metrics  should  be  measurable  and  manageable 
and  map  back  to  the  higher-level  program  metrics.  For  example,  a  PSP 
may  be  responsible  for  the  availability  of  their  product  and  the  associated 
metric  may  be  supply  material  availability  or  logistics  response  time.  Too 
many  metrics  make  it  difficult  to  manage  and  may  also  work  at  cross 
purposes  to  each  other.  Also,  data  must  be  available  for  the  metric.  There 
have  been  occasions  where  metrics  were  required  as  part  of  an 
arrangement  without  the  ability  to  collect  the  data  to  determine 
performance  against  the  metric.  (ASD  (L&MR)  2014,  1 14) 

Some  common  metrics  applied  in  PBL  are  as  follows.  Keep  in  mind,  this  is  not  an 

exhaustive  list  of  all  possible  metrics  that  can  be  used  in  a  PBL  arrangement,  but  is 

merely  included  here  to  familiarize  the  reader  with  some  of  the  most  common  ones. 

•  Operational  Availability  (Ao) — The  percentage  of  time  that  a  system  or 
group  of  systems  within  a  unit  are  operationally  capable  of  performing  an 
assigned  mission  and  can  be  expressed  as  uptime/(uptime+downtime) 
(ASD  (L&MR)  2014,  133). 
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•  Materiel  Availability  (Am) — The  percentage  of  the  total  inventory  of  a 
system  operationally  capable  (ready  for  tasking)  of  perfonning  an 
assigned  mission  at  a  given  time,  based  on  materiel  condition  (ASD 
(L&MR)  2014,  134). 

•  Mean  Time  Between  Failure  (MTBF) — For  a  particular  interval,  the  total 
functional  life  of  a  population  of  an  item  divided  by  the  total  number  of 
failures  (requiring  corrective  maintenance  actions)  within  the  population 
(ASD  (L&MR)  2014,  133). 

•  Mean  Time  To  repair  (MTTR) — The  total  elapsed  time  (clock  hours)  for 
corrective  maintenance  divided  by  the  total  number  of  corrective 
maintenance  actions  during  a  given  period  (ASD  (L&MR)  2014,  136). 

•  Logistics  Response  Time  (LRT) — The  amount  of  time  (measured  in  mean 
days)  that  elapses  from  the  date  a  customer  establishes  a  requisition  to  the 
date  the  customer  receives  the  material  that  was  ordered  (ASD  (L&MR) 
2014,  136). 

1.5.5  Establish  Contracts/Agreements 

To  obtain  performance  based  product  support,  a  PSM  must  document  the 
arrangements  necessary  to  meet  the  needs  of  the  warfighter.  PBL  arrangements  can  be 
documented  in  the  form  of  a  contract  or  agreement. 

1.5. 5.1  Identify  Contract  Type/Length 

For  obtaining  perfonnance  based  product  support,  there  are  many  different  types 
of  contracts  from  which  a  program  manager  must  decide,  with  the  assistance  of  the 
program’s  Procurement  Contracting  Officer  (PCO).  As  one  of  the  key  tenets  of  PBL,  a 
“Finn  Fixed  Price  (FFP)  contract  is  generally  the  preferred  contract  type  (however,  Fixed 
Price  Incentive  Fee  (FPIF)  and  Cost  Plus  Incentive  Fee  (CPIF)  may  be  effective)  (ASD 
(L&MR)  2014,  114). 

When  coupled  with  a  requirement  to  deliver  a  Warfighter  relevant 
outcome  versus  delivery  of  a  part  or  service,  a  FFP  contract  converts  a 
traditional  revenue  center  in  a  transactional  business  model  to  a  cost  center 
under  PBL.  The  provider  is  required  to  deliver  a  specific  Warfighter 
relevant  outcome  for  a  set  price.  It  transfers  the  financial  risk  from  the 
Government  to  the  provider.  In  this  fashion,  it  acts  as  a  powerful  incentive 
for  PSIs  and  PSPs  to  improve  the  reliability  of  their  product  and  the 
efficiency  of  their  processes  in  order  to  reduce  their  cost  to  deliver  the 
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desired  outcome.  The  lower  their  cost  to  perform,  the  greater  the  provider 
profit  associated  with  the  fixed  price.  In  order  to  transfer  risk  in  this 
fashion  to  the  provider,  the  failure  modes  and  rates  need  to  be  stable 
enough  to  reasonably  forecast  demand.  Otherwise,  the  provider  will  price 
in  the  difficulty  with  assessing  the  risk  ultimately  becoming  an 
unaffordable  option. 

As  the  uncertainty  and  associated  risk  increases,  a  more  appropriate 
contract  type  would  be  a  FP1F  or  a  CP1F  arrangement.  FP1F  contracts 
provide  a  mechanism  for  the  provider  to  reduce  costs  while  sharing  those 
cost  savings  with  the  Government.  Without  sharing,  there  can  be  instances 
when  the  Government  does  not  fully  understand  the  actual  costs  or  the 
cost-saving  opportunities  available  to  the  provider.  The  further  the 
contract  type  moves  from  FFP  and  FP1F  toward  cost  plus,  the  less 
incentive  there  is  for  the  provider  to  improve  the  product  and  lean  out  their 
processes  (without  reasonable  assurance  of  a  follow-on  arrangement). 
Conversely,  a  cost-plus  fixed-fee  contract  is  generally  not  appropriate  for 
PBL  arrangements.  (ASD  (L&MR)  2014,  1 14-1 15) 

The  length  of  a  PBL  contract  is  also  considered  a  key  tenet  in  obtaining  PBL 
support.  The  PBL  Guidebook  (2014)  states,  “Provide  sufficient  contract  length  for  the 
product  support  provider  to  recoup  investments  on  improved  product  (e.g.,  MTBF)  and 
sustainment  processes  (e.g.,  manufacturing  capabilities)”  (ASD  (L&MR)  2014,  115). 
A  typical  PBL  contract  could  be  live  years  or  more  in  length.  An  additional  benefit  to 
longer  contracts  is  less  frequent  turnover  of  service  providers,  which  could  provide  more 
stability  and  continuity  in  product  support,  while  fostering  longer  relationships  and  more 
trust  between  PSMs  and  PSPs.  Lastly,  with  less  frequent  turnover  of  contracts,  the 
government  will  expend  less  time  and  resources  toward  the  source  selection  process  of 
identifying  a  prevailing  contractor  each  time  a  contract  is  up  for  competition. 

1.5. 5.2  Identify  Agreement  Type 

A  performance-based  agreement  is  essential  for  a  PSM  or  PS1  to  document 
performance  targets  or  expectations  and  identify  associated  perfonnance  incentives  for  a 
PSP  to  execute  toward.  A  contract  can  be  a  type  of  performance-based  agreement  when  a 
contractor  is  fulfilling  the  PSP  role.  However,  if  the  PSP  is  an  organic  government 
organization,  a  Memorandum  of  Agreement  (MOA),  Memorandum  of  Understanding 
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(MOU),  or  Service-Level  Agreement  (SLA)  may  be  more  appropriate  to  document  the 
relationship  and  performance  expectations. 

1.5.6  Perform  Business  Case  Analysis  (BCA) 

A  BCA  is  required  by  Public  Law  1 1 1-84,  Sec  805,  dated  28  October  2009,  and 
requires  a  PSM  to  “conduct  appropriate  cost  analyses  to  validate  the  product  support 
strategy,  including  cost-benefit  analyses  as  outlined  in  Office  of  Management  and  Budget 
Circular  A-94.”  A  BCA  is  a  tool  for  PSMs  to  help  identify  whether  a  PBL  arrangement  is 
a  value-added  approach  to  buying  product  support. 

D.  SUMMARY 

The  definitions  and  descriptions  of  each  of  the  elements  above  are  intended 
to  provide  an  understanding  of  the  model  and  its  components.  With  a  better 
understanding  of  the  elements  of  the  model  and  how  they  describe  the  basic  necessities 
for  implementation  of  PBL,  one  can  see  how  informational  gaps  in  policy  and  guidance 
can  be  identified  by  assessing  whether  a  given  document  addresses  some,  all  or  none  of 
the  elements.  In  the  next  chapter,  a  gap  analysis  is  perfonned  for  the  selected  PBL-related 
policy  and  guidance  documents,  based  on  the  definitions  and  descriptions  of  the  model 
elements  in  this  chapter. 
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IV.  REVIEW  OF  POLICY/GUIDANCE  AND 
RECOMMENDATIONS 

A.  APPROACH  FOR  GAP  ANALYSIS 

To  conduct  a  gap  analysis  of  the  current  DOD  guidance  and  documentation 
regarding  the  implementation  of  PBL,  this  thesis  first  proposed  a  PBL  implementation 
model  in  Chapter  III.  This  model  was  used  to  assess  the  completeness  of  each  selected 
current  policy  and  guidance  document  to  identify  any  infonnational  gaps  that  may  exist. 
To  identify  these  gaps,  each  of  the  selected  documents  were  critically  reviewed  and 
analyzed  to  find  where  they  either  satisfactorily  cover  or  fail  to  address  the  criteria  for 
each  applicable  element  in  the  model.  The  elements  that  are  not  adequately  covered  are 
identified  and  addressed  in  this  chapter.  For  each  document,  these  gaps  are  graphically 
depicted  in  the  PBL  implementation  model  to  clearly  show  the  elements  where  the 
deficiencies  exist.  Finally,  recommendations  are  provided  for  closing  each  of  the 
identified  gaps. 

The  selected  review  documents  are  organized  into  two  tiers  by  type,  namely 
Policies  and  Guidance.  The  two  groups  of  documents,  depending  on  their  aim  and 
purpose,  have  elements  within  the  model  that  are  typically  associated  with  each.  The 
Policy  documents  primarily  address  the  high  level  elements  in  the  model  as  they  are 
aimed  at  describing  what  must  be  done,  and  not  so  much  on  how  they  must  be  done.  The 
Guidance  documents  are  an  assortment  of  guidebooks  that  provide  a  lower  level  of  detail 
on  how  to  implement  PBL,  among  other  acquisition  or  logistics  concerns,  and  were 
written  chiefly  to  assist  PMs,  PSMs  and  program  staffs,  as  opposed  to  merely  directing 
policy.  The  documents  reviewed  and  their  associated  tier  levels  are  as  follows: 

Policy  Documents: 

•  DODD  5000.01  (May  12,  2003) 

•  DODI 5000. 02  (January  7,2015) 

•  USD  (AT&L)  Memorandum  “ Better  Buying  Power  3.0 ”  (April  9,  2015) 

•  ASD  (L&MR)  PBL  Comprehensive  Guidance  (November  22,  2013) 
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Guidance  Documents: 


•  ASD  (L&MR)  Product  Support  Manager  Guidebook  (April  2011) 

•  ASD  (L&MR)  PEL  Guidebook  (May  27,  2014) 

B.  HOW  THE  PBL  IMPLEMENTATION  MODEL  IS  USED 

In  Figure  6,  the  model  elements  within  the  boundary  of  the  red  dashed  lines 
primarily  pertain  to  the  Policy  level  of  documents.  In  Figure  7,  the  model  elements  within 
the  boundary  of  the  red  dashed  lines  identify  the  domain  of  the  Guidance  documents. 
Although  the  depictions  of  the  model  in  Figures  6  and  7  suggest  that  Policy  and  Guidance 
documents  each  have  their  own  definitive  boundaries,  it  was  anticipated  that  there  would 
be  some  overlap  between  Policy  and  Guidance  documents.  As  an  example,  this  is 
especially  true  for  ASD  L&MR’s  PBL  Comprehensive  Guidance  (2013)  memorandum, 
where  a  mixture  of  directive  policy  and  reference-like  guidance  information  was  put 
forth  together  in  one  document.  A  detailed  explanation  of  the  document  is  provided  later 
in  this  chapter.  The  gray  boxes  indicate  elements  that  are  not  applicable  for  the  type  of 
document  being  reviewed.  For  example,  for  policy  documents  covered  by  Figure  6,  the 
element  “Provide  Resources”  and  its  subordinate  elements  are  not  applicable  because  it  is 
assumed  that  resources,  such  as  funding  and  manpower,  will  be  provided  by  the 
implementing  organization  and  its  command  structure.  For  guidance  documents  covered 
by  Figure  7,  the  element  “Publish  Policy”  and  its  subordinate  element  do  not  apply 
because  that  is  not  the  purpose  or  authority  of  guidance  documents. 
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Figure  6.  Policy  Domain  in  PBL  Implementation  Model 
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Figure  7.  Guidebook  Domain  in  PBL  Implementation  Model 
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For  each  of  the  documents  reviewed  and  analyzed  in  this  thesis,  a  graphic  model 
is  included  to  show  where  the  informational  gaps  were  found.  The  elements  that  were 
found  to  be  adequately  covered  to  facilitate  PBL  implementation  were  colored  green.  The 
deficient  elements  were  colored  red.  In  some  documents,  certain  elements  were 
discussed,  but  not  in  a  manner  that  was  determined  to  be  helpful  for  successful 
implementation  of  PBL.  These  elements  were  colored  yellow. 

As  previously  stated  in  Chapter  II,  all  PBL  policy  and  guidance  reviewed  are  at 
the  DOD  level  and  not  at  the  component  Services  level  because  the  amount  of  DOD  level 
documentation  was  found  to  be  abundant  and  pertinent  for  the  scope  of  this  thesis. 

C.  GAPS  IN  POLICY  LEVEL  DOCUMENTATION 

The  policy  documents  reviewed  in  this  section  establish  the  regulatory  foundation 
for  implementing  PBL.  They  generally  aim  to  establish  policy  to  direct  PMs  and  PSMs, 
and  their  associated  staffs,  to  plan  and  execute  efficient  and  effective  product  support 
strategies  to  meet  warfighter  readiness  needs  and  reduce  life  cycle  costs.  As  mentioned 
previously  and  depicted  in  Figure  6,  PBL-related  policy  documents  generally  address  the 
higher  level  elements  in  the  model  (elements  1.1  through  1.6).  Therefore,  the  identified 
gaps  and  associated  recommendations  in  Section  C  will  only  address  these  higher  level 
elements. 

1.  DODD  5000.01 

DODD  5000.01  The  Defense  Acquisition  System,  certified  current  as  of  November 
20,  2007,  is  the  chief  document  establishing  policy  for  all  DOD  acquisition  programs 
(USD  (AT&L),  2007).  It  is  important  to  note  that  per  DODI  5025.01  (2014),  this  DODD 
is  restricted  to  no  more  than  ten  pages  in  length  and  should  contain  no  procedures  (DOD 
2014).  However,  because  of  the  high  level  of  this  document,  it  is  important  that  it  not 
only  establish  policy,  but  also  provide  a  succinct  but  clear  definition  of  any  concept  it  is 
mandating,  especially  in  the  case  of  PBL.  It  fails  to  provide  a  clear  definition  of  PBL. 
This  is  critical  in  laying  the  foundation  for  proper  implementation  of  the  PBL  concept  as 
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it  flows  down  the  requirement  to  all  other  supporting  or  subordinate  policy  documents, 
such  as  DODI 5000. 02  (20 1 5). 

DODD  5000.01  (2007)  does  contain  language  addressing  PBL.  It  states  the 
following: 

PMs  shall  develop  and  implement  perfonnance-based  logistics  strategies 
that  optimize  total  system  availability  while  minimizing  cost  and  logistics 
footprint.  Trade-off  decisions  involving  cost,  useful  service,  and 
effectiveness  shall  consider  corrosion  prevention  and  mitigation. 
Sustainment  strategies  shall  include  the  best  use  of  public  and  private 
sector  capabilities  through  government/industry  partnering  initiatives,  in 
accordance  with  statutory  requirements.  (USD  (AT&L)  2007,  7) 

This  document  is  not  a  useful  reference  to  facilitate  implementation  of  PBL.  This 
is  not  unexpected,  as  policy  documents,  especially  those  limited  in  scope  by  other 
regulations,  typically  do  not  contain  lower  level  details.  These  lower  level  details  are 
typically  found  in  guidance  documents  and  are  also  would  be  helpful  for  implementers. 

This  document  is  deficient  in  the  following  top-level  elements  (the  essential 
elements  that  are  important  for  a  policy  level  document  for  PBL): 

1.1  Provide  Guidance 

1 .4  Identify  Stakeholders/Roles 

1.5  Define  PBL  and  its  Elements 

1.6  Review  PBL  for  Efficacy 

The  deficient  elements  in  the  model  for  this  document  are  clearly  seen  (shown  in 
red)  in  Figure  8.  The  model  also  identifies  some  lower  level  elements  that  are  addressed 
by  this  document  to  illustrate  areas  of  overlap  into  domains  where  the  lower  level 
guidance  of  guidebooks  provide  similar  infonnation. 
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Gaps  and  Recommendations 

1 . 1  Provide  Guidance:  The  primary  gap  identified  here  is  this  document  does  not 
provide  any  specific  guidance  that  would  help  a  PM  or  logistician  implement  PBL 
effectively.  Although  it  can  be  argued  that  this  DODD,  in  accordance  with  DODI 
5025.01  (2014),  is  not  required  to  give  any  procedures  or  guidance  on  how  to  implement 
PBL,  it  should  refer  or  point  to  additional  sources  of  information  to  help  PBL 
practitioners,  ft  is  also  conceded  that  at  the  time  of  this  DODD’s  writing  in  2007,  there 
were  few,  if  not  any,  DOD  level  guidebooks  published  that  comprehensively  addressed 
PBL.  All  of  the  other  DOD  guidebooks  reviewed  in  this  thesis  were  published  well  after 
2007  and  since  have  been  updated  with  more  details  concerning  PBL  and  how  to 
implement  it. 

Recommendation:  Although  more  detailed  DOD  level  guidance  came  out  after 
this  DODD’s  publishing,  it  is  recommended  that  a  future  revision  of  this  document 
include  references  to  the  new  guidebooks  that  fill  this  gap.  For  example,  it  should  provide 
references  to  the  new  PBL  Guidebook  (2014),  the  PSM  Guidebook  (2011),  as  well  as  the 
Defense  Acquisition  Guidebook  (2013).  This  referencing  of  other  documents  may  be  an 
appropriate  solution  considering  the  inherent  informational  limitation  of  a  ten  page  or  less 
DODD  level  document. 

1.4  Identify  Stakeholders/Roles:  The  date  of  publication  for  DODD  5000.01 
(2007)  precedes  the  establishing  of  the  Product  Support  Manager  (PSM),  which  came 
into  being  in  2009  (ASD  (L&MR)  2013). 

Recommendation:  Introduce  the  PSM  and  its  role  in  a  future  revision  of  DODD 
5000.01  (2007). 

1.5  Define  PBL  and  its  Elements:  This  document  fails  to  define  PBL  adequately. 
It  only  addresses  a  sub-element  of  the  element,  Define  PBL,  in  the  model.  This  sub¬ 
element,  Identify  Goals,  has  three  lower  level  elements  a)  Increase  Sustainability/RAM, 
b)  Decrease  Logistics  Footprint,  and  c)  Reduce  Cost.  These  are  addressed  in  DODD 
5000.01  (2007)  in  the  statement,  “PMs  shall  develop  and  implement  performance-based 
logistics  strategies  that  optimize  total  system  availability  while  minimizing  cost  and 
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logistics  footprint”  (USD  (AT&L)  2007,  7).  However,  it  does  not  identify  the  main 
principles  of  PBL  as  stated  in  Chapter  I  of  this  thesis. 

Recommendation:  In  order  to  fill  this  gap,  the  next  revision  of  this  document 
should  include  a  more  comprehensive  definition  of  PBL.  This  thesis  recommends  An 
easy  solution  is  to  incorporate  the  definition  found  in  the  PBL  Guidebook  (2014), 
published  by  ASD  (L&MR)  in  May  2014,  which  says,  “PBL  is  synonymous  with 
performance-based  life  cycle  product  support,  where  outcomes  are  acquired  through 
performance-based  arrangements  that  deliver  Warfighter  requirements  and  incentivize 
product  support  providers  to  reduce  costs  through  innovation.  These  arrangements  are 
contracts  with  industry  or  intra-govemmental  agreements”  (ASD  (L&MR)  2014,  8).  In 
addition,  the  definition  should  be  modified  by  adding  a)  delivering  warfighter 
requirements  also  means  optimizing  weapon  system  availability  via  well-defined  metrics 
and  b)  incentivizing  product  support  providers  reduces  costs  and  logistics  footprint 
through  innovation.  Finally,  it  is  recommended  that  it  also  mention  perfonning  a  business 
case  analysis  to  detennine  how  best  to  apply  PBL. 

1.6  Review  PBL  for  Efficacy:  There  are  no  specific  means  identified  in  this 
document  to  report  status  of  a  program’s  PBL  arrangement  to  the  Milestone  Decision 
Authority  (MDA).  In  the  document,  it  states: 

El.  1.20.  Program  Information.  Complete  and  current  program  infonnation 
is  essential  to  the  acquisition  process.  Consistent  with  the  tables  of 
required  regulatory  and  statutory  information  appearing  in  reference  (b), 
decision  authorities  shall  require  PMs  and  other  participants  in  the  defense 
acquisition  process  to  present  only  the  minimum  information  necessary  to 
establish  the  program  baseline,  describe  program  plans,  understand 
program  status,  and  make  informed  decisions.  The  MDA  shall  “tailor-in” 
program  information.  IPTs  shall  facilitate  the  management  and  exchange 
of  program  information.  (USD  (AT&L)  2007,  7) 

This  is  problematic  in  two  ways.  First,  this  document  calls  out  “reference  (b),” 
which  is  the  outdated  May  12,  2003,  DODI  5000.2.  It  was  superseded  by  the  newer 
DODI  5000.02,  dated  November  25,  2013.  Second,  when  a  PM  presents  their  program  to 
the  MDA,  the  document  merely  requires  them  to  provide  “only  the  minimum  information 
necessary  to  establish  the  program  baseline,  describe  program  plans,  understand  program 
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status,  and  make  informed  decisions”  (USD  (AT&L)  2007,  8).  It  is  unclear  whether 
reporting  on  PBL  use  would  be  included  or  meets  the  threshold  of  inclusion  when 
addressing  all  critical  decision  points  in  a  complex  acquisition. 

Recommendation:  In  the  next  revision  of  DODD  5000.01  (2007),  the  references 
list  should  be  updated  to  point  to  the  more  current  DODI  5000.02  (2015)  document.  The 
newer  DODI  5000.02  (2015)  includes  several  means  of  identifying  whether  PBL  is  used 
or  not  to  decision  makers.  One  of  the  means  is,  “The  DOD  Components  will  conduct 
independent  logistics  assessments  for  all  weapon  system  MDAPs  prior  to  Milestones  B 
and  C  and  the  Full-Rate  Production  Decision  to  assess  the  adequacy  of  the  product 
support  strategy,  and  to  identify  features  that  are  likely  to  drive  future  operating  and 
support  costs,  changes  to  system  design  that  could  reduce  costs,  and  effective  strategies 
for  managing  such  costs”  (USD  (AT&L)  2013,  1 17).  Also,  all  Milestone  Decision  events 
include  a  review  of  the  program’s  Life  Cycle  Sustainment  Plan  (LCSP),  which  captures 
the  product  support  strategy  for  a  program.  Therefore,  by  updating  the  reference,  the 
Review  For  Efficacy  element  in  the  model  would  be  satisfied  and  effective  reporting  of 
PBL  as  the  product  support  strategy  will  be  communicated  to  senior  decision  makers. 

2.  DODI  5000.02 

DODI  5000.02  Operation  Of  The  Defense  Acquisition  System,  dated  January  7, 
2015,  identifies  the  overarching  management  principles  and  mandatory  policies 
governing  the  Defense  Acquisition  System.  Enclosure  6  is  the  section  that  pertains  to  Life 
Cycle  Sustainment.  With  regard  to  PBL,  this  document  states  that  the  PM,  with  the 
support  of  the  PSM,  will,  “Employ  effective  perfonnance-based  logistics  (PBL)  planning, 
development,  implementation,  and  management  in  developing  a  system’s  product  support 
arrangements.  PBL  is  performance-based  product  support,  where  outcomes  are  acquired 
through  performance-based  arrangements  that  deliver  warfighter  requirements  and 
incentivize  product  support  providers  to  reduce  costs  through  innovation”  (USD  (AT&L) 
2015a,  113).  This  document  also  directs  that  they  continually  evaluate  and  revise  the 
product  support  approach,  while  also  monitoring  for  product  support  performance  so  as 
not  to  negatively  impact  system  availability  and  cost  (USD  (AT&L)  2015a).  DODI 
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5000.02  (2015)  provides  more  guidance  and  information  about  product  support  than 
DODD  5000.01  (2007).  However,  it  too,  fails  to  provide  adequate  guidance  specifically 
to  implement  PBL.  The  document  provides  a  definition  of  PBL  and  also  identifies  that 
PSIs  and  PSPs  can  be  organic,  commercial,  or  a  combination  of  both.  The  document  also 
identifies  specific  support  metrics,  although  they  are  not  explicitly  mentioned  as 
appropriate  PBL-related  metrics.  This  document  does  serve  the  purpose  of  publishing 
policy  stating  the  PM  and  PSM  will  employ  PBL. 

This  document  is  not  a  useful  reference  to  facilitate  implementation  of  PBL.  This 
is  not  unexpected,  as  policy  documents  typically  do  not  contain  the  lower  level  elements 
in  the  model,  which  are  typically  found  in  supplemental  guidance  documents. 

DODI  5000.02  (2015)  is  deficient  in  the  following  top-level  elements  (the 
essential  elements  that  are  important  for  a  policy  level  document  for  PBL): 

1 . 1  Provide  Guidance 

1 .4  Identify  Stakeholders/Roles 

1.5  Define  PBL  and  its  Elements 

1.6  Review  PBL  for  Efficacy 

The  deficient  elements  in  the  model  for  this  document  are  shown  in  red  in  Figure 
9.  The  model  also  identifies  some  lower  level  elements  that  are  addressed  by  this 
document  to  illustrate  areas  of  overlap  into  domains  where  the  lower  level  guidance  of 
guidebooks  provide  similar  infonnation. 
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Figure  9.  Model  Analysis  Results  for  DODI  5000.02 
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Gaps  and  Recommendations 

1.1  Provide  Guidance:  DODI  5000.02  (2015)  failed  to  provide  adequate  guidance 
necessary  to  support  implementation  of  PBL.  It  failed  to  reference  available  guidance 
documents  that  could  provide  additional  information  to  help  implementers  of  PBL.  For 
example,  it  should  provide  references  to  the  new  PBL  Guidebook  (2014),  the  PSM 
Guidebook  (2011),  as  well  as  the  Defense  Acquisition  Guidebook  (2013).  Interestingly, 
the  reference  list  did  include  the  O&S  Cost  Estimating  Guide  (2014),  which  may  seem  to 
indicate  that  the  DOD  has  a  greater  focus  on  the  cost  of  their  acquisition  programs.  DODI 
5000.02  (2015)  also  failed  to  provide  any  examples  of  PBL  or  lessons  learned  to  facilitate 
better  employment  of  PBL. 

Recommendation:  To  rectify  this  shortfall,  simply  update  the  references  list  in 
DODI  5000.02  (2015)  to  include  the  PBL  Guidebook  (2014),  the  PSM  Guidebook  (2011), 
and  the  Defense  Acquisition  Guidebook  (2013).  This  would  provide  PBL  implementers 
with  a  reference  for  additional  information  that  may  help  them  in  employing  PBL. 

1.4  Identify  Stakeholders/Roles:  This  document  makes  no  mention  of  the  Supply 
Chain  Management  (SCM)  function  and  its  importance  to  product  support,  especially  in  a 
PBL  arrangement.  Employing  an  efficient  SCM  function,  regardless  of  whether  it  is 
provided  by  an  organic  or  commercial  organization,  is  essential  to  meeting  the  objective 
of  PBL  and  meeting  Warfighter  readiness  needs  while  potentially  reducing  life  cycle 
costs. 

Recommendation:  Include  language  in  the  document  emphasizing  the  importance 
of  SCM  as  a  function  in  a  PBL  arrangement. 

1 .5  Define  PBL  and  its  Elements:  There  are  several  issues  within  this  high  level 
element  that  pose  an  issue  for  implementing  PBL.  First,  the  document  does  not  mention 
one  of  the  goals  of  PBL,  reducing  the  logistics  footprint.  This  goal  is  aimed  at  reducing 
assets  and  resources  needed  to  sustain  the  system.  By  doing  so,  a  PSP  can  reduce  life 
cycle  costs  and  reduce  the  logistical  burden  on  deploying  a  system  (ASD  (L&MR)  2011). 
Also,  the  document  does  not  address  the  applicability,  or  not,  of  PBL  to  a  system’s 
product  support  needs.  This  is  primarily  because  this  policy  document  mandates  the  use 

45 


of  PBL,  regardless  of  feasibility  or  applicability.  This  is  an  issue  that  is  further  addressed 
in  Chapter  V.  Lastly,  this  document  does  not  address  agreement  types,  contract  types  or 
appropriate  contract  length  for  PBL. 

Recommendation:  Include  language  about  reducing  logistics  footprint  as  a  goal  of 
employing  PBL.  Addressing  feasibility  or  applicability  of  PBL  will  be  problematic  unless 
the  policy  is  changed  to  accommodate  this.  Again,  this  is  addressed  as  a  major  finding  in 
Chapter  V.  Finally,  this  document  should,  at  a  minimum,  mention  performance  based 
agreements  as  the  vehicle  to  establish  performance  requirements  and  associated 
incentives  resulting  from  achieved  support  perfonnance.  Contract  length  is  important  as 
well  and  should  be  included  to  emphasize  that  longer  term  arrangements  encourage  PSPs 
to  make  upfront  investments  to  increase  system  availability,  while  allowing  the  PSP  time 
to  recoup  those  costs  over  the  life  of  a  PBL  arrangement. 

1 .6  Review  PBL  for  Efficacy:  This  document  failed  to  provide  a  means  for  PMs 
and  PSMs  to  specifically  review  PBLs  for  efficacy  and  report  status  to  senior  leadership, 
so  as  to  provide  awareness  on  challenges  and  successes  of  PBL  arrangements  in  the  field. 

Recommendation:  Include  language  directing  PBL  reporting  and  specifically 
identify  PBL  as  a  part  of  a  data  package  to  be  reported  to  senior  leadership.  DODI 
5000.02  (2015)  does  direct  PMs  to  perform  Independent  Logistics  Assessments  (ILA), 
whereby,  they  would  have  a  channel  for  reporting  product  support  status  to  leadership. 
Simply  adding  language  to  include  PBL  reporting  as  part  of  the  ILA  process  would  direct 
PMs  to  provide  details  on  how  their  program  is  employing  PBL.  This  would  also  further 
instill  the  notion  that  PBL  is  now  a  part  of  our  DOD  culture  with  appropriate  emphasis. 

3.  USD  (AT&L)  Memorandum  “ Better  Buying  Power  3.0” 

Better  Buying  Power  (BBP)  3.0  (2015)  is  the  third  in  a  series  of  implementation 
directives  and  attachments  provided  by  the  Under  Secretary  of  Defense  (AT&L)  to 
increase  the  productivity,  efficiency,  and  effectiveness  of  the  DOD’s  acquisition, 
technology  and  logistics  efforts.  PBL  is  specifically  addressed  in  BBP  2.0  (2012)  and 
BBP  3.0  (2015)  and  has  resulted  in  ASD  (L&MR)  creating  in  2013  the  PBL 
Comprehensive  Guidance  document,  as  well  as  the  PBL  Guidebook  (2014).  The  BBP 
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policy  documents  provide  an  indication  of  how  serious  the  DOD  is  about  implementing 
PBL. 

The  BBP  2.0  (2012)  and  BBP  3.0  (2015)  documents  provide  a  fair  amount  of 
guidance  on  PBL.  As  part  of  BBP  2.0  (2012),  the  Defense  Acquisition  University  (DAU) 
stood  up  two  classroom  courses  and  ten  distance  learning  and  online  courses  for  PBL. 
DAU  also  established  a  dedicated  team  of  PBL  experts  to  assist  and  train  PBL 
implementers  in  each  of  the  DOD  components  with  the  mission  of  helping  them  develop 
and  manage  PBL  arrangements. 

A  key  aspect  of  BBP  3.0  (2015)  is  that  it  directs  several  specific  actions  to  ensure 
the  effective  use  of  PBL: 

•  “ASD  (L&MR)  will  continue  to  work  with  the  Services  and  other  DOD 
Components  to  develop  common  ways  to  measure  PBL  effectiveness, 
including  benefits  and  savings,  and  to  use  those  measures  to  track  results. 
Results  of  this  effort  will  be  reported  to  USD  (AT&L)  and  the  Business 
Senior  Integration  Group  (BSIG)  on  a  quarterly  basis”  (USD  (AT&L) 
2015b,  9). 

•  “As  under  BBP  2.0,  and  using  these  effectiveness  measures  as  they 
are  developed  and  implemented,  the  Component  Acquisition 
Executives  (CAEs)  will  provide  updates  by  July  2015  to  the  BSIG 
on  the  implementation  of  PBL  arrangements,  including 
determining  the  accessible  market  by  Component,  the  ongoing  use 
of  PBL  arrangements,  plans  for  additional  PBL  arrangements,  and 
progress  toward  those  plans.  Additional  updates  will  be  provided 
on  a  quarterly  basis  thereafter”  (USD  (AT&L)  2015b,  9). 

•  “ASD  (L&MR)  will  assess  the  business  case  analyses  for  selected 
current  and  ongoing  PBL  arrangements  and  will  provide  the  results 
of  those  assessments  to  USD  (AT&L)  as  they  become  available.  In 
addition,  ASD  (L&MR)  will  update  the  PBL  Guidebook  by 
October  2015,  incorporating  lessons  learned  and  best  practices 
from  industry  and  across  DOD.  As  part  of  that  update,  ASD 
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(L&MR),  with  DPAP  and  the  DOD  Components,  will  assess 
improvements  for  developing,  reviewing,  approving,  and 
contracting  for  PBL  arrangements”  (USD  (AT&L)  2015b,  9). 

•  “DAU  will  update  PBL  learning  assets  to  reflect  the  above 
assessments  and  lessons  learned,  including  case  studies,  by 
February  2016,  following  the  update  of  the  Guidebook”  (USD 
(AT&L)  2015b,  9). 

BBP  3.0  (2015)  is  deficient  in  the  following  top-level  elements  (the  essential 
elements  that  are  important  for  a  policy  level  document  for  PBL): 

1 .4  Identify  Stakeholders/Roles 

1 .5  Define  PBL  and  its  Elements 

The  deficient  elements  in  the  model  for  this  document  are  shown  in  red  in  Figure 
10.  The  model  also  identifies  some  lower  level  elements  that  are  addressed  by  this 
document  to  illustrate  areas  of  overlap  into  domains  where  the  lower  level  guidance  of 
guidebooks  provide  similar  infonnation. 
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Figure  10.  Model  Analysis  Results  for  Better  Buying  Power  3.0 
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Gaps  and  Recommendations 

1.4  Identify  Stakeholders/Roles:  BBP  3.0  (2015)  fails  to  identify  the  most  critical 
stakeholders  and  implementers  of  PBL,  namely  the  PM  and  PSM.  Both  the  PM  and  PSM 
are  clearly  identified  in  DODI  5000.02  (2015)  as  key  responsible  parties  in  ensuring  PBL 
is  implemented  at  the  program  level.  Without  identifying  at  least  these  two  key 
stakeholders,  a  service  or  component  level  acquisition  leader  may  not  understand  who  in 
his/her  organization  is  responsible  for  PBL  implementation.  Also,  the  text  specifically 
covering  PBL,  and  ensuring  its  effective  use,  never  links  the  benefits  of  effective  PBL  to 
increasing  availability  of  a  weapon  system  to  the  end  user,  or  warfighter.  Instead,  it 
merely  states  that  it  ensures  best  value  for  DOD.  This  approach  is  vague  and  lacks  focus 
on  a  very  important  purpose  of  PBL,  which  is  to  obtain  necessary  system  readiness  levels 
and  meet  warfighter  needs. 

Recommendation:  At  a  minimum,  add  the  PM  and  PSM  into  the  next  version  of 
BBP  3.0  (2015)  text  as  responsible  stakeholders  critical  for  the  implementation  of  PBL. 
In  addition,  adding  language  to  link  the  benefits  of  effectively  employing  PBL  to 
availability  of  weapon  systems  to  the  warfighter  may  provide  compelling  justification  of 
just  how  important  PBL  is. 

1.5  Define  PBL  and  its  elements:  This  document  does  not  adequately  define  or 
address  some  of  the  elements  of  PBL  that  are  needed  to  provide  a  clear  picture  of  what  it 
is.  The  language  in  BBP  3.0  (2015)  on  PBL  may  mislead  readers  to  believe  that  it  is  the 
only  way  to  obtain  support  for  DOD  weapon  systems.  This  supports  DODD  5000.01 
(2007)  and  DODI  5000.02  (2015),  which  both  mandate  that  PMs  employ  PBL.  However, 
this  is  in  contrast  to  the  ASD  (L&MR)  comprehensive  guidance  that  is  referenced  in  BBP 
3.0  (2015),  which  identifies  that  PBL  arrangements  may  not  be  appropriate  for  all  support 
situations  (ASD  (L&MR),  2013).  BBP  3.0  (2015)  also  does  not  identify  any  metrics  that 
would  be  useful  in  a  PBL  arrangement.  It  also  fails  to  capture  all  of  the  goals  for  using 
PBL.  It  mentions  balancing  cost  and  performance,  but  never  ties  PBL  to  reducing 
logistics  footprint,  improving  system  reliability  or  availability,  or  meeting  end  user  or 
warfighter  needs/requirements. 
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Recommendation:  The  DOD  needs  to  reconcile  the  conflicts  between  the  various 
policy  documents  that  address  PBL.  ASD  (L&MR)’s  PBL  Comprehensive  Guidance 
(2013)  and  PSM  Guidebook  (2011)  both  indicate  that  PBL  may  not  be  appropriate  for  all 
support  situations.  However,  DODD  5000.01  (2007)  and  DODI  5000.02  (2015)  use 
directive  language  to  mandate  the  use  of  PBL.  This  finding  is  emphasized  in  Chapter  V 
of  this  thesis.  BBP  3.0  (2015)  may  be  strengthened  by  including  some  example  metrics, 
like  those  described  in  Chapter  I  of  this  thesis,  that  are  common  in  effective  PBL 
arrangements.  Also,  BBP  3.0  (2015)  can  benefit  from  linking  the  benefits  of  employing 
effective  PBL  to  the  end  user  or  warfighter.  Adding  language  explaining  the  goals  and 
how  they  impact  DOD’s  overall  mission  could  provide  clearer  rationale  as  to  why  PBL  is 
DOD’s  preferred  support  strategy. 

4.  ASD  (L&MR)  PBL  Comprehensive  Guidance 

On  November  22,  2013,  the  ASD  (L&MR)  published  the  PBL  Comprehensive 
Guidance  (2013)  memorandum  on  the  subject  of  increasing  effective  use  of  PBL.  The 
purpose  of  the  document  is  to  bolster  the  message  from  Better  Buying  Power  2.0  and  help 
the  Services  better  implement  PBL.  Although  the  document  provides  guidance,  it  is  a 
policy  document  because  it  directs  the  services  to  provide  details  and  status  of  PBL 
arrangements  to  senior  leaders  and  foster  education  of  PM  and  PSM  professionals  via 
DAU  training  courses  and  learning  assets.  This  document  establishes  a  concerted  effort 
across  DOD  aimed  at  reviewing  the  efficacy  of  PBL  arrangements  and  to  establish  a 
reporting  chain  for  improved  focus  and  communication  at  all  echelons  of  the  workforce 
across  the  DOD.  In  addition,  this  document  tasks  functional  leads  for  acquisition  career 
fields  to  inform  DAU  of  any  changes  to  keep  PBL  training  current.  DAU,  in  turn,  is 
tasked  to  provide  a  repository  of  lessons  learned  and  best  practices  to  share  with  the 
workforce. 

The  PBL  Comprehensive  Guidance  (2013)  document  also  provides  a  definition  of 
PBL  and  describes  attributes  of  effective  PBL  arrangements.  These  attributes  include  the 
following: 
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•  an  objective  and  measurable  description  of  work  leading  to  a  desirable 
outcome 

•  appropriate  contract  length,  type,  and  funding  approach 

•  appropriate  metrics  to  produce  desired  outcomes 

•  incentives  aimed  at  producing  desired  outcomes  and  cost  reduction 

•  shared  risks  and  rewards  between  government  and  commercial  PSIs  and 
PSPs 

•  synchronizing  of  support  arrangements  to  meet  warfighter  requirements 

This  is  the  first  official  document  to  address  whether  PBL  is  applicable  or  not 
when  planning  for  support  for  a  system,  which  is  a  departure  from  all  other  policy 
documents  that  state  PBL  is  mandatory  for  all  support  situations.  It  includes  some 
specific  characteristics  or  circumstances  leading  to  successful  PBL  arrangements,  as 
taken  from  previous  DOD  experience.  It  says  that  if  a  program  exhibits  any  of  these 
characteristics,  then  PBL  should  be  considered.  These  circumstances  include:  poor 
system  availability/performance,  workload  or  part  demand  has  achieved  a  level  of 
predictability,  there  are  enough  support  providers  in  a  competitive  market,  there  is 
adequate  system  operational  life  (five  to  seven  years,  typically)  for  support  providers  to 
recoup  investments,  commonality  of  parts/components  across  the  Services  or  DOD 
provide  leverage  for  economies  of  scale  for  providers  and  gives  the  government 
negotiating  leverage,  or  support  costs  exceed  life  cycle  cost  estimates  and  an  opportunity 
for  cost  reduction  exists  within  reason. 

PBL  applicability  for  system  support  is  further  clarified  by  this  document  by 
providing  some  circumstances  where  it  may  not  make  sense  as  a  product  support 
arrangement.  It  suggests,  for  example,  that  newly  fielded  systems,  especially  those  where 
little  or  no  knowledge  of  the  reliability  of  it  or  its  components  exists,  may  pose  too  much 
risk  to  be  placed  on  a  PSP  (set  up  for  failure).  Another  situation  where  PBL  may  not  be 
suitable  is  if  a  weapon  system  is  utilized  in  an  environment  or  manner  for  which  it  was 
not  intended.  This  would  reduce  predictability  of  a  system’s  reliability  or  supportability 
and  a  PSP  may  not  be  able  to  meet  system  availability  or  dependability  requirements.  The 
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topic  of  PBL  applicability  and  assessing  when  PBL  should  or  should  not  be  considered  is 
discussed  further  in  Chapter  V. 

The  PBL  Comprehensive  Guidance  (2013)  document  provides  a  wealth  of 
information  that  is  helpful  toward  implementing  PBL.  However,  it  is  deficient  in  the 
following  top-level  elements: 

1 .4  Identify  Stakeholders/Roles 

1.5  Define  PBL  and  its  Elements 

Figure  1 1  shows  the  deficiencies  of  this  document  graphically  in  the  model.  The 
model  also  identifies  some  lower  level  elements  that  are  addressed  by  this  document  to 
illustrate  areas  of  overlap  into  domains  where  the  lower  level  guidance  of  guidebooks 
provide  similar  infonnation. 
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Figure  1 1 .  Model  Analysis  Results  for  PBL  Comprehensive  Guidance 
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Gaps  and  Recommendations 

1.4  Identify  Stakeholders/Roles:  This  document  fails  to  mention  the  PSM.  The 
PSM  is  the  PM’s  point  person  for  implementing  product  support.  It  also  fails  to  identify 
the  Supply  Chain  Management  function,  as  well  as  other  functional  representatives 
typically  needed  in  an  IPT  setting  to  implement  PBL.  These  other  functional  subject 
matter  experts  typically  include  contracting  specialists,  financial  managers,  legal 
representatives,  and  systems  engineers. 

Recommendation:  No  action  is  recommended.  This  policy  document  is  a  one-time 
publication  that  fills  the  gap  between  BBP  2.0  (2012)  guidance  and  the  referenced  future 
PBL  Best  Practices  Guidebook  (never  published),  which  shortly  after  became  the  PBL 
Guidebook  issued  by  ASD  (L&MR),  in  May  of  2014.  The  deficiencies  noted  here  are 
remedied  in  that  PBL  Guidebook  (2014),  which  is  also  reviewed  later  in  this  thesis. 

1.5  Define  PBL  and  its  Elements:  This  document  did  not  identify  the  BCA  as  an 
important  tool  to  help  in  detennining  which  type  of  product  support  arrangement 
provides  best  value  to  the  PM  and  PSM.  Including  a  BCA  in  the  document  could  have 
reinforced  the  assessment  of  circumstances  described  that  help  identify  whether  PBL  is 
applicable  to  a  product  support  situation  or  not. 

Recommendation:  No  action  is  recommended  for  the  same  reasons  stated  above. 
The  new  PBL  Guidebook  published  in  May  of  2014  addresses  BCAs  and  their  purpose. 
This  PBL  Comprehensive  Guidance  (2013)  document  clarifies  and  supplements  the 
policies  set  in  BBP  2.0  (2012)  and  remains  an  excellent  reference  for  PMs  and  PSMs 
responsible  for  planning  product  support  for  programs. 

D.  GAPS  IN  GUIDANCE  LEVEL  DOCUMENTS 

The  DOD  guidance  level  documents  pertaining  to  PBL  were  published  to  support 
and  clarify  previously  established  DOD  policy  level  documents  containing  PBL-related 
policies,  such  as  the  Better  Buying  Power  directives,  DODD  5000.01  (2007)  and  DODI 
5000.02  (2015).  Therefore,  guidance  level  documents  contain  more  lower  level  detail  and 
information,  as  is  identified  in  Figure  7.  Thus,  the  gaps  and  recommendations  will 
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address  issues  in  the  lower  level  elements  and  not  the  higher  level  elements  like  the 
policy  documents.  If  any  of  the  lower  level  elements  are  identified  as  deficient  in  the 
model,  then  the  associated  higher  level  element  (elements  1.1  through  1.6)  is  also 
identified  as  deficient.  Failure  to  address  all  elements  and  sub-elements  in  the  model 
represents  a  shortfall  in  that  document  precluding  it  from  fully  assisting  PMs  and  PSMs 
in  implementing  PBL. 

1.  ASD  (L&MR)  PSM  Guidebook 

The  PSM  Guidebook,  published  in  May  of  2011,  is  a  guidance  document 
specifically  aimed  at  assisting  PSMs  and  PMs  on  how  to  plan  and  execute  a  product 
support  strategy.  It  presents  a  thorough  approach  to  product  support  planning  of  which 
PBL  is  merely  one  of  several  potential  outcomes.  The  PSM  Guidebook  (2011)  focuses  on 
Product  Support  Arrangements  (PSAs),  which  can  take  the  form  of  PBL,  sustainment 
support,  Contractor  Logistics  Support  (CLS),  life  cycle  product  support,  or  weapon 
systems  product  support  (ASD  (L&MR)  2011).  This  is  in  striking  contrast  to  the  policies 
in  DODD  5000.01  (2007),  DODI  5000.02  (2015),  and  Better  Buying  Power  3.0  (2015), 
which  all  mandate  the  effective  use  of  PBL.  This  conflict  in  policy  is  a  major  finding  that 
is  further  addressed  in  Chapter  V. 

There  are  several  concepts  introduced  in  the  PSM  Guidebook  (2011)  that  assist 
PMs  and  PSMs  toward  developing  and  executing  product  support  strategies.  This 
document  establishes  the  12-Step  Product  Support  Strategy  Process  Model  for  product 
support  planning,  which  is  later  used  as  a  template  in  planning  for  PBL  in  the  PBL 
Guidebook  (2014)  (ASD  (L&MR)  2014).  This  twelve-step  process  model  is  shown  in 
Figure  12.  The  PSM  Guidebook  (2014)  also  presents  the  important  product  support 
planning  activities  that  typically  need  to  be  accomplished  for  each  major  life  cycle  phase 
(ASD  (L&MR)  2014).  Lastly,  this  document  presents  the  concept  of  Sustainment 
Maturity  Level  (SML),  which  is  described  as  a  best  practice  for  identifying  the  activities 
that  should  be  executed  to  ensure  a  program  is  developing  a  product  support  strategy  to 
deliver  the  required  sustainment  capability  when  needed  (ASD  (L&MR)  2014).  This 
SML  concept  is  similar  to  the  Technology  Readiness  Assessment  process,  which  uses 
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Technology  Readiness  Levels  (TRLs)  to  evaluate  the  maturity  and  risks  associated  with 
critical  technologies  in  a  program  (Assistant  Secretary  of  Defense  for  Research  and 
Engineering  2011). 
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Figure  12.  The  Twelve  Steps  of  Product  Support  Planning  (from  ASD  (L&MR) 

2011,34) 


Although  the  PSM  Guidebook  (2014)  describes  product  support  planning  and 
strategy  in  general  and  does  not  necessarily  focus  on  PBL  throughout  the  document, 
much  of  the  guidance  can  be  applied  to  PBL.  The  document  contains  useful  guidance  on 
determining  resource  needs  for  product  support  planning,  including  cost  estimation 
information  and  various  funding  strategies.  It  also  identifies  stakeholders  and  provides  a 
detailed  description  of  the  roles  and  responsibilities  of  key  participants  in  the  product 
support  planning  process.  It  also  defines  the  elements  such  as  product  support 
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arrangement  types,  goals  of  product  support,  incentives  for  PSPs,  as  well  as  applicable 
metrics  for  achieving  desired  support  outcomes  (ASD  (L&MR)  2011). 

Overall,  the  PSM  Guidebook  (2014)  is  a  good  reference  for  product  support 
information  that  may  be  applicable  for  implementation  of  PBL.  However,  it  does  fall 
short  of  specifically  providing  guidance  to  PSMs  on  how  to  implement  PBL.  In  the 
document,  product  support  is  approached  in  a  general  sense,  which  does  obscure  PBL  in 
the  sense  that  PSMs  have  other  options  besides  PBL  as  potential  product  support 
strategies.  As  noted  before,  this  is  in  conflict  with  other  policy  documents  mandating 
PBL  as  the  exclusive  product  support  approach  to  use.  The  expansion  of  options  for 
product  support  from  simply  PBL  or  transaction-based  support  is  stated  in  the  guidebook 
for  the  primary  purpose  of  meeting  warfighter  operational  readiness  needs  (ASD 
(L&MR)  2011).  In  Figure  13,  the  model  is  used  to  depict  where  this  document  is 
deficient  in  the  following  element: 

1 . 1 . 1 .2  Provide  Examples 

Figure  13  shows  the  identified  deficient  element  in  the  model. 
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Figure  13.  Model  Analysis  Results  for  PSM  Guidebook 
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Gap  and  Recommendation 

1.1. 1.2  Provide  Examples:  The  document  did  not  provide  any  examples  of 
programs,  notional  or  real,  to  help  explain  how  the  various  product  support  strategies 
could  be  employed.  More  specifically,  it  did  not  provide  any  examples  of  effective  uses 
of  PBL  arrangements.  Examples,  especially  those  from  empirical,  real  world 
observations,  can  provide  invaluable  insight  to  product  support  planners  to  help  them 
learn  how  to  tailor  PSAs  to  their  program’s  specific  needs.  A  program  may  already  exist 
in  the  DOD  that  has  similar  characteristics  and  needs,  so  that  a  PM  or  PSM  can  simply 
adopt  like  practices  and  do  so  with  improved  confidence  that  the  strategy  will  produce  the 
desired  outcomes. 

Recommendation:  Add  examples  of  Performance  Based  Agreements  so  that 
implementers  can  at  least  have  a  format  to  work  from.  Also,  providing  at  least  a  notional 
program  to  guide  readers  through  how  a  product  support  strategy,  like  PBL,  can  be 
achieved.  The  more  recent  PBL  Guidebook  (2014)  provides  a  notional  program  example 
to  show  what  must  be  considered  when  planning  for  PBL.  However,  the  PSM  Guidebook 
(2011)  would  still  benefit  fonn  incorporating  an  example  because  it  takes  a  broader 
approach  to  describing  the  process  of  planning  for  general  product  support,  of  which  PBL 
is  just  one  of  the  types  of  arrangements  presented. 

2.  ASD  (L&MR)  PBL  Guidebook 

The  PBL  Guidebook  was  published  May  27,  2014,  and  represents  a  collaborative 
effort  between  ASD  (L&MR),  the  Services,  and  DAU,  to  provide  better  guidance  to  PMs, 
PSMs  and  logisticians  responsible  for  implementing  PBL.  This  document  was  written  to 
support  BBP  2.0  (2012)  and  the  PBL  Comprehensive  Guidance  (2013)  documents. 

The  PBL  Guidebook  (2014)  is  the  most  comprehensive  and  descriptive  document 
published  to  date  for  guidance  on  PBL  implementation.  A1  Banghart,  a  senior  advisor  at 
Deloitte  Consulting  LLP,  who  has  worked  extensively  with  the  Pentagon’s  procurement 
office,  said  of  the  PBL  Guidebook  (2014),  “Until  just  last  month,  program  offices  did  not 
have  any  substantive  tools  to  help  guide  them  through  the  PBL  deployment  process” 
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(Erwin  2014).  The  quote  was  obtained  from  a  blog  article  written  by  author  Sandra  Erwin 
on  May  7,  2015,  posted  to  the  National  Defense  Magazine  website  (Erwin  2014). 

The  PBL  Guidebook  (2014)  addresses  all  of  the  elements  in  the  model,  as  can  be 
seen  in  Figure  14.  It  contains  a  vast  amount  of  information  beneficial  to  PMs,  PSMs  and 
any  program-level  staff  involved  in  implementing  PBL.  The  document  identifies  PBL 
best  practices  and  lessons  learned,  as  well  as  a  thorough  Question  and  Answer  section 
addressing  numerous  topics  under  PBL.  It  also  contains  a  useful  list  of  references 
pertaining  to  PBL  and  product  support  in  general.  The  document  introduces  a  feasibility 
analysis  that  indicates  whether  a  PBL  arrangement  is  feasible  or  not  for  a  given  program. 
One  key  stand-out  feature,  that  all  other  DOD  guidance  or  policy  documents  fail  to 
provide  adequately,  is  the  inclusion  of  relevant  examples.  The  document  contains  a 
sample  draft  contract  to  illustrate  how  a  PBL  contract  could  be  set  up.  It  provides 
hardware-focused  examples  of  PBL  arrangements  that  can  also  serve  as  a  guide  for  Major 
Automated  Information  Systems  (MAIS),  which  are  typically  software  intensive 
programs  (ASD  (L&MR)  2014).  In  addition,  it  provides  “a  notional  Generic  Subsystem 
(GSS)(that  implements  a  PBL  solution  with  a  commercial  Original  Equipment 
Manufacturer  (OEM))”  (ASD  (L&MR  2014,  3).  This  GSS  example  is  also  intertwined 
through  the  12-Step  Product  Support  Strategy  Process  Model,  previously  introduced  in 
the  PSM  Guidebook  (2011)  and  depicted  in  Figure  12,  to  show  how  that  process  can  be 
utilized  for  PBL  support  planning. 

The  results  of  the  analysis  performed  with  the  model  are  shown  in  Figure  14.  All 
elements  in  the  model  were  addressed  by  this  document. 
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Figure  14.  Model  Analysis  Results  for  PBL  Guidebook 
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As  can  be  seen  from  the  model  for  the  PBL  Guidebook  (2014),  all  elements  are 
addressed  satisfactorily.  So,  does  that  mean  a  user  of  the  guidebook  can,  without  fail, 
successfully  implement  PBL  for  any  product  support  requirement?  Unfortunately,  in 
practice,  the  solution  is  not  that  simple.  The  model  shows  that  the  PBL  Guidebook  (2014) 
is  the  best  enabler  by  providing  the  most  comprehensive  and  pertinent  information  about 
implementing  PBL.  However,  every  program’s  sustainment  needs  are  unique.  DAU 
states,  “There  is  no  onc-sizc-fits-all  approach  to  PBL.  Similarly,  there  is  no  template 
regarding  sources  of  support  in  PBL  strategies.  Almost  all  of  DOD’s  system  support 
comprises  a  combination  of  public  (organic)  and  private  (commercial)  support  sources” 
(DAU  2005,  2-4).  As  mentioned  earlier,  the  PBL  Guidebook  (2014)  even  introduces  a 
feasibility  analysis  to  test  whether  a  PBL  arrangement  is  applicable  or  not  to  a  weapon 
system’s  support  needs.  Also,  the  DAU  statement  introduces  another  issue  regarding 
public  (organic)  support  sources.  Organic  support  organizations  do  not  operate  off  of  a 
profit  motive  like  commercial  contractors.  Therefore,  what  incentives  can  legally  be 
extended  to  an  organic  support  provider  aside  from  an  ultimatum  for  them  to  either  meet 
performance  objectives  in  the  PBA  or,  upon  failure  to  meet  the  perfonnance  objectives, 
take  the  workload  away  and  outsource  it?  This  issue  will  be  revisited  in  Chapter  V  as  a 
suggested  future  research  topic. 
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V.  CONCLUSION 


A.  OVERVIEW 

The  gap  analysis  and  recommendations  performed  and  provided  in  Chapter  IV 
identified  areas  for  improvement  in  each  of  the  reviewed  documents.  Most  issues 
included  recommendations  that  could  potentially  rectify  the  deficiencies  within  that 
document.  However,  several  larger,  overarching  issues  were  discovered  that  could  not 
simply  be  attributable  to  one  single  document,  but  are,  in  fact,  problems  that  trend  across 
several  documents.  These  larger  issues,  or  major  findings,  are  captured  in  this  chapter 
along  with  recommendations  from  the  author.  Finally,  recommendations  of  areas  for 
future  research  are  identified  and  discussed. 

B.  MAJOR  FINDINGS  AND  RECOMMENDATIONS 

1.  Conflicting  Policies  and  Guidance 

A  major  finding  through  analysis  of  the  policy  documents  is  an  inconsistent 
message  about  whether  or  not  PBL  is  mandatory.  Three  of  the  four  policy  documents 
reviewed  in  this  thesis  indicated  that  PBL  must  be  used  to  acquire  product  support  for  a 
DOD  weapon  system.  DODD  5000.01  (2007),  DODI  5000.02  (2015),  and  Better  Buying 
Power  3.0  (2015)  all  require  PBL.  Statements  like  “Shall  develop  and  implement,”  “Will 
employ,”  and  “Ensure  effective  use,”  describe  the  policies  toward  PBL  in  each  of  the 
three  documents,  respectively.  The  fourth  policy  document  reviewed  is  the  PBL 
Comprehensive  Guidance  (2013),  which  identified  circumstances  where  PBL  may  not  be 
appropriate  (ASD  (L&MR)  2013).  This  is  a  dramatic  reversal  in  position  of  PBL  being 
mandatory  in  the  first  three  policy  documents.  It  is  critical  that  policy  documents  all  be 
consistent  with  each  other  in  order  to  effectively  and  uniformly  direct  implementation  of 
PBL,  or  any  initiative  for  that  matter. 

The  PBL  Guidebook  (2014)  also  suggests  that  PBL  is  not  the  only  product  support 
strategy  available  for  use  by  PMs  and  PSMs.  It  introduces  a  feasibility  analysis  to 
determine  whether  PBL  meets  a  specific  program’s  product  support  needs  or  not.  This 

inherently  suggests  that  other  product  support  strategies,  such  as  the  classic  transaction- 
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based  approach  or  CLS  are  potential  options.  Of  course,  this  is  not  consistent  with  the 
directive  language  found  in  three  of  the  four  policy  documents.  Interestingly,  the  one 
policy  document  that  does  not  indicate  that  PBL  is  the  only  product  support  solution  is 
published  by  ASD  (L&MR).  This  same  office  published  the  PBL  Guidebook  (2014), 
which  also  states  that  PBL  is  simply  one  of  several  product  support  strategies  available  to 
the  PM  and  PSM  (ASD  (L&MR)  2014).  Oppositely,  the  three  policy  documents 
mandating  PBL  are  all  published  by  USD  (AT&L). 

Recommendation:  As  can  be  seen  through  the  PBL-related  policy  and  guidance 
documents  published  through  the  two  offices,  there  is  division  between  them  on  whether 
PBL  is  applicable  or  feasible  for  all  product  support  needs.  Policy  and  guidance  needs  to 
align  between  the  two  organizations  to  put  forth  a  consistent  and  clear  message  about 
PBL  implementation.  ASD  (L&MR)  provides  a  convincing  argument  for  keeping  the 
door  open  for  other  product  support  strategies,  especially  in  cases  where  a  PBL  strategy 
may  not  make  the  most  sense.  Therefore,  it  is  the  opinion  of  the  author  that  policy 
currently  mandating  PBL  for  all  product  support  situations  be  modified  to  allow  for  other 
product  support  strategies  in  circumstances  where  PBL  is  not  feasible  or  optimal. 
Emphasis  can  still  be  placed  on  considering  PBL  where  it  is  the  best  option,  so  long  as  it 
produces  the  desired  outcomes  that  it  is  purported  to  achieve. 

2.  Determining  Applicability  or  Feasibility  of  PBL 

A  major  finding,  as  a  result  of  the  analysis  performed,  is  the  lack  of  clarity  on 
determining  whether  PBL  is  applicable  or  feasible  for  all  product  support  situations.  The 
three  policy  documents  that  mandate  PBL,  as  identified  previously  in  this  chapter,  do  not 
address  this  because  it  is  not  congruent  with  their  conveyed  message  that  PBL  will  be 
employed  for  all  product  support  arrangements.  The  PBL  Guidebook  (2014)  introduces  a 
PBL  feasibility  analysis  as  part  of  a  data  gathering  activity  to  help  the  PSM  assess 
whether  PBL  will  work  for  the  program  or  not.  It  is  much  like  a  small  Business  Case 
Analysis  (BCA),  except  the  feasibility  analysis  outcome  is  binary:  PBL  is  feasible  or  not. 
BCAs  differ  in  that  they  typically  are  more  in-depth  and  recommend  an  optimal  product 
support  strategy  based  on  various  considered  alternatives.  Most  of  the  other  policy  and 
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guidance  documents  reviewed  mention  the  BCA  as  a  tool  to  help  the  PM  and  PSM 
determine  which  product  support  strategy  is  best  for  a  system.  The  two  exceptions  are  the 
PBL  Comprehensive  Guidance  (2013)  document  and  DODD  5000.01  (2007),  of  which 
both  provide  no  guidance  at  all  on  BCAs  or  on  assessing  applicability  or  feasibility  of 
PBL  for  a  system. 

As  already  noted,  the  BCA  is  a  tool  for  PMs  and  PSMs  to  detennine  which 
product  support  strategy  achieves  the  optimal  balance  between  warfighter  capabilities  and 
affordability  (ASD  (L&MR)  2011a).  DODI  5000.02  (2015)  and  BBP  3.0  (2015)  both 
mention  BCAs.  However,  BBP  3.0  (2015)  only  directs  ASD  (L&MR)  to  review  and 
assess  BCAs  for  selected  and  current  programs  that  employ  a  PBL  strategy.  This  neglects 
the  BCAs  for  all  of  the  other  programs  that  do  not  employ  PBL,  which  could  be  a  good 
source  of  information  for  why  they  did  not  select  PBL.  DODI  5000.02  (2015)  mentions  a 
BCA  as  a  required  annex  to  every  program’s  Life  Cycle  Sustainment  Plan  (LCSP)  (USD 
(AT&L)  2015a).  Nonetheless,  if  policy  is  directing  PBL  to  be  employed  for  all  programs 
with  product  support  needs,  then  a  BCA  does  not  seem  to  be  needed  since  that  decision 
has  already  been  made  by  policy.  Thus,  there  is  no  consistency  across  the  various  policy 
and  guidance  documents  for  detennining  feasibility  or  applicability  of  PBL  for  programs. 

Recommendation:  A  major  part  of  this  issue  about  applicability  or  feasibility  of 
PBL  stems  from  the  previously  mentioned  major  finding  that  some  policies  mandate  PBL 
while  one  other  policy  document  and  other  guidebooks  offer  alternative  product  support 
solutions  and  PBL  feasibility  analyses.  Thus,  the  recommendation  for  this  issue  will  be 
made  with  the  assumption  that  the  previous  recommendation  of  modifying  all  policies  to 
allow  for  other  product  support  strategies  is  implemented.  With  that  impediment 
removed,  policies  can  then  be  modified  to  include  that  feasibility  analyses  be  performed 
to  detennine  if  PBL  is  feasible  or  not  for  candidate  programs.  The  feasibility  analysis 
mentioned  in  the  PBL  Guidebook  (2014)  can  be  incorporated  into  the  BCA  as  an  initial 
step  in  that  process  to  help  narrow  down  the  potential  support  strategy  options. 
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3.  Use  of  Examples 

Of  the  six  policy  and  guidance  documents  reviewed,  only  one  incorporates  a 
descriptive  example  of  how  to  implement  PBL.  That  document  is  the  PBL  Guidebook 
(2014),  which  employs  the  Generic  Subsystem  (GSS)  example  to  show  how  planning 
PBL  for  a  hardware-based  system  might  be  accomplished,  as  well  as  providing  numerous 
considerations  and  best  practices  for  each  product  support  planning  step  (ASD  (L&MR) 
2014).  However,  all  of  the  other  policy  and  guidance  documents  were  completely  devoid 
of  any  examples.  Through  the  use  of  examples,  PBL  implementers  can  see  how  others 
have  employed  this  complex  product  support  strategy  effectively  in  the  past. 
Additionally,  they  can  also  see  what  has  worked  for  PBL  arrangements  that  have  been 
used  on  programs  with  similar  characteristics  or  circumstances,  thus  preventing  others 
from  having  to  “reinvent  the  wheel”  and  save  valuable  resources  and  time  spent  toward 
applying  PBL,  as  opposed  to  researching  and  learning  how  to  implement  it  anew. 

Recommendation:  Develop  a  database  of  records  and  documents  from  previous 
successful  PBL  arrangements  and  make  them  accessible  to  PMs,  PSMs  and  the 
DOD  community  of  logisticians.  ASD  (L&MR)  is  an  ideal  candidate  organization  for 
creating  and  maintaining  such  a  database,  as  they  are  responsible  for  publishing 
guidance  and  disseminating  information  across  the  DOD  for  PBL  implementation. 
Documenting  into  a  common  database  successful  PBL  arrangements  that  may  be 
applicable  for  similar  programs  with  comparable  support  needs  and  characteristics  could 
be  beneficial  to  ensure  useful  PBL  examples  can  be  shared  with  other  programs  and 
stakeholders.  Mr.  Frank  Kendall,  the  current  USD  (AT&L),  has  acknowledged  that 
employing  PBL  arrangements  can  have  a  steep  learning  curve  (Erwin  2014).  The  use  of 
existing  examples  may  enable  quicker  apprehension  of  PBL  and  promote  innovative 
thinking  among  practitioners  of  PBL. 


68 


C.  SUMMARY  OF  RESEARCH  QUESTIONS 

In  Chapter  I,  several  research  questions  were  posed  to  frame  the  topics  and  issues 
that  this  thesis  would  examine.  These  research  questions  and  corresponding  assessments, 
as  a  result  of  the  research  performed,  are  summarized  here. 

Are  current  and  applicable  DOD  policy  and  guidance  documents  adequate  to 
facilitate  PBL  implementation? 

The  policy  and  guidance  documents  addressed  in  this  thesis  are  the  most  current 
and  relevant  sources  of  information  for  PBL  at  the  DOD  level.  The  results  of  the  analysis 
performed  in  Chapter  IV  suggest  that  there  are  two  documents,  the  PSM  Guidebook 
(2011)  and  PBL  Guidebook  (2014),  that  contain  a  fairly  comprehensive  amount  of 
information  useful  for  PBL  implementation.  The  PBL  Guidebook  (2014),  in  particular, 
satisfactorily  addressed  all  elements  in  the  author’s  PBL  Implementation  Model, 
indicating  that  it  is  the  best  stand-alone  source  of  guidance  for  enabling  PBL 
implementation.  The  reviewed  policy  documents  all  satisfy  the  purpose  of  establishing 
policy.  However,  they  lean  heavily  on  the  follow-up  guidebooks  to  provide  a  more 
thorough  explanation  of  the  PBL  concept.  However,  it  is  not  clear  whether  PBL  is 
mandatory  or  not  for  all  product  support  arrangements.  As  mentioned  above  in  the  first 
major  finding,  this  inconsistency  between  policy  documents  and  guidance  needs  to  be 
rectified  to  eliminate  confusion  within  DOD  on  whether  it  is  mandatory  or  not.  Although 
there  is  excellent  information  available  in  both  guidebooks  to  enable  implementation  of 
PBL,  the  policy  discrepancies  must  be  corrected  in  order  for  DOD  policy  and  guidance  to 
truly  be  adequate. 

What  informational  gaps  exist  in  the  current  DOD  policies  and  guidance  that  may 
pose  issues  for  implementing  PBL? 

Chapter  IV  provided  results  and  recommendations  to  the  gaps  identified  in  the 
analysis.  Except  for  the  PBL  Guidebook  (2014),  the  analysis  identified  informational 
gaps  in  all  other  reviewed  documents.  Finally,  the  major  findings  earlier  in  this  chapter 
covered  the  major  findings  that  trended  across  multiple  documents  and  posed  the  most 
significant  issues  hindering  PBL  implementation. 
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What  changes  and  recommendations  can  be  proposed  to  close  these  informational 
gaps  to  better  assist  DOD program  managers  and  logisticians  in  implementing  PBL? 

The  changes  and  recommendations  for  the  identified  informational  gaps  are 
provided  in  Chapter  IV  for  the  specific  document  changes  and  earlier  in  Chapter  V  for 
the  major  findings  that  trended  across  the  reviewed  documents. 

D.  AREAS  FOR  FURTHER  RESEARCH 

During  this  research,  several  areas  for  future  study  were  discovered  that  could 
benefit  implementers  of  PBL.  These  potential  future  topics  either  expand  on  some  of  the 
major  findings  in  this  thesis  or  consider  new  areas  for  further  research  that  are  related  to 
PBL  but  are  outside  of  the  scope  of  this  thesis. 

Research  potential  incentives  for  PBL  arrangements  with  organic  (non¬ 
commercial)  support  providers. 

Almost  all  of  the  reviewed  policy  and  guidance  documents  recognize  the  use  of 
both  organic  or  commercial  support  providers.  As  noted  by  DAU,  “Almost  all  of  DOD’s 
system  support  comprises  a  combination  of  public  (organic)  and  private  (commercial) 
support  sources”  (DAU  2005,  2).  Therefore,  it  is  critical  that  PBL  practitioners 
understand  how  to  address  organic  support  sources  in  PBL  arrangements.  However,  none 
of  the  reviewed  documents  mention  any  specific  incentives  or  examples  of  PBL 
arrangements  involving  organic  support  providers.  One  researcher  noted,  “The  best  PBLs 
are  CLS  because  contractors  can  be  incentivized  and  penalized  with  money.  They  can  be 
held  accountable”  (Coryell  2007,  85).  Can  organic  support  providers  be  held  accountable 
in  a  similar  fashion? 

Provide  an  assessment  of  PBL  and  its  overall  performance  as  a  product  support 
strategy  in  DOD. 

There  have  been  several  assessments  of  PBL  in  the  past,  including  two 
Government  Accountability  Office  reports,  a  2006  University  of  Maryland  evaluation 
(Gansler  and  Lucyshyn  2006),  and  the  2012  “ Proof  Point  Study ”  (Boyce  and  Banghart 
2012),  that  provided  insight  into  PBL  and  its  achievements.  A  new  up-to-date  look  at 
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PBL  may  be  warranted  to  find  out  if  PBL  is  being  used  effectively  for  DOD  programs 
and  to  discern  if  it  is  truly  producing  the  desired  results.  It  is  also  alarming  to  note,  as 
identified  in  the  National  Defense  Magazine  blog  article  by  Sandra  Erwin,  “Fewer  than 
90  PBL  contracts  are  in  place  today  -  less  than  half  the  number  that  existed  in  2005.  Few 
new  PBLs  are  being  pursued,  and  the  military  services  are  choosing  to  not  renew  some 
existing  PBLs”  (Erwin  2014).  A  current  total  of  qualified  PBL  arrangements  in  use  across 
the  DOD  and  how  they  are  performing  can  provide  additional  insight  into  PBL’s 
effectiveness. 

Perform  an  analysis  of  Service  level  PBL  policy  and  guidance  (Air  Force,  Army, 
Navy,  Marine  Corps,  etc.). 

Further  research  into  how  the  different  services  in  the  DOD  are  employing  PBL 
may  provide  insight  for  PBL  practitioners  as  well.  The  scope  of  this  thesis  looked  only  at 
DOD  level  policy  and  guidance.  Implementation  of  PBL  at  the  services  level  may 
identify  innovative  approaches  to  buying  product  support. 

Objective  assessment  model  for  validating  feasibility  of  PBL  for  product  support 

needs. 

Another  potential  area  of  exploration  is  the  concept  of  validating  feasibility  of 
PBL  to  a  system’s  product  support  needs.  The  PBL  Guidebook  introduced  a  feasibility 
analysis  to  determine  whether  PBL  is  feasible  or  not  for  a  weapon  system  (ASD  (L&MR) 
2014).  The  development  of  a  model  or  checklist  to  guide  PMs  and  PSMs  through  a 
validation  process  to  determine  whether  PBL  is  feasible  for  their  program  could  be  very 
useful.  Part  of  the  analysis  could  be  to  determine  what  conditions  or  circumstances 
indicate  whether  PBL  is  feasible  or  not.  The  PBL  Comprehensive  Guidance  (2013) 
document  provides  two  sample  circumstances  where  PBL  may  not  be  the  appropriate 
product  support  strategy  (ASD  (L&MR)  2013).  It  is  the  author’s  opinion  that  there  may 
be  other  circumstances  where  PBL  may  not  make  sense,  such  as  a  product  support 
arrangement  with  a  small  business  that  cannot  assume  the  level  of  risk  associated  with 
PBL  arrangements,  or  a  weapon  system  that  has  high  levels  of  reliability/availability  and 
reasonable  support  costs  through  traditional  sustainment  arrangements.  Thus,  a  model  or 
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checklist  that  addresses  many  different  circumstances  or  conditions  as  part  of  the 
validation  process  would  assist  product  support  planners  to  better  determine  whether  PBL 
is  feasible  or  not  for  their  weapon  system. 
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